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In the spring of 1979, the National Institute 
Educat:ion, in collaboration wit)i the United States Office of 
Education, the UCLA Center for the Study of Evaluation (CSE), 
members of a" nation-wide network of research and development 
agencies, sponsored a national colloquy on the theme that testing 
"coulrl have an- important impact in improving the ef f ect ivenes,s of 
instrudtion, but that much remained to be understood about testing 
needs and problems. Eight regional conferences were held. Each 
conference involved presentations from national and regional figures 
in the area of testing and instruction . The conferences ^al^o provided 
an initial training opportunity in test development and test 
selection to acquaint part i??ipants with some of the newer ideas in 
the field. Each conference devoted its second day to important 
regional issues and^needs. The recommendations of the regional 
conferences ,can be synthesized as iEollows; (1), current testing 
perspeotive^need to be refocused; (2) decisions about test ^' 
'development and selection should involve a m^cjft broader' constituency 
than is presently the case; (-3) the ' instruct ional application of 
testing needs to be. refined; and (4) greater^ coordination is needed 
among federal, state, and local testing needs. Some implications 
growing from these recommendations are presented. (Author/BW) 
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The mission of the Center for the Study of Evaluation is to conduct 
inquiry, from a variety of perspectives, into thfe nature of educational 
programs and services. Our commitment to inquiry into the field nf 
evaluation grows.from the belief that school practices and the compe- 
tencies and satisfactiD^is of those who participate in the educationaf 
enterprise can benefit from information collected in accordance with so- 
cial science. methodologies. Activities of CSE involve study of the 
instruments and methodologies for collecting information as well as the 
s^)ciopolitical contexts of educational decisions as a mearis of contribu- 
ting to the long-range growth in effectiveness of public education. 

Information about CSE and its;publications may be obtained by 
writing to: ^ ' - o 

Director, PublTc Information ' * 
Center for the Study of Evaluation, 
UCLA Graduate School of Education. 
Los Angeles,, California 90024 
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EXECUTIVE SUMMARY 
NIE REGIOm tONFERENCES ON TESTING AND INSTRUCTION 

In the Spring of 1979, the National Institute of Education. 1n collab- 
oration with the United States Office of Education, the UCLA Center for the' 
Study of Evaluation (CSE), and members of a nation-wide network of research 
and development agencies, sponsored a national colloquy on the role of test- 
ing in the public schools. Of strongest significance was* the conference- 
theme that testing could have an important impact in improving the effed- 
tiveness of instruction, but that much remained to be understood *about test- 
ing needs an^j^ problems. Eight regional conferences were held as a way to 
share information among approximately 1200 participants. These people re- 
presented the community, parents groups > and the professions of teaching, 

- / 

educational research, policy, and administration and represented local, 
state, and regiorwil interests. 

Each conference involved presentations frok national and regional fig- 
ures in the area of testing and instruction, and Included university pro- 
fessors, representatives of professional organizations, publishers, and 
school personnel. The conferences also provided an initial, training oppor- 
tunity in test development and test selection to acquaiint participants fur- 
ther with some of the newer ideas in the field. Each conference focused 
its second day on regionally iinportant Issues and needs. Significant out- 
comes of the project were the recorranendations provided from this diverse 
group on areas for continued support at the federal level. In addition, ^ 
an edited set of speakers' papers and the'training materials In test de- 
velopment and selection were also important resources developed frofn the set 
of conferences. Agencies providing local support and organization were: 
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The Network • - 

Research for Better Schbols ^ 
Southeastern Regional Corisortium 
CEMREL. Inc. 

Southwes"'t- Educational-' Development Laboratory 
Midcontinent Regional Educational Laboratory 
Farwest Regional Educational Laboratory 
Northwest Regional Educational Laboratory 



Overall' conf^erence support sfnd- materials preparation were the responsibility 



The recommendations of the Regional Conferences can be synthesized as 



current testing, perspectives need to be refocused - 
decijsions about test development and selection* should involve 
a much broader constituency than isPpresently the case 
the 'instructional application of testing needs to be refined 
... greater coordination is needed among federal, state, and local 
testing needs. , - ' 

Some implications growing from these recommendations are presented. 

Work associated with the planning and concluct of the regional confer- 
ences took place between October 1978 and $eptember 1979. Work associated 
with the product revisions took place between April 1 and August 31, 1980, 
The final products of the contract extension consist of (1 ) a book of read- 
ings on testing' and instruction compiled from the invited speakers at each > 
regional conference, and (2) a set of training materials on test development 
and selection drawn from the materials introduced at the conferences. 
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follows: ' 




THE REGIONAL CONFERENCES: PLANNING. PURPOSE^ AND PROCEDURES, AND FClLOW-UP ^ 

Overview to the Conferences 

On March 1-3, -1978, the Department of Health, Education and Welfare 
convened a National Conference on Achievement Tests and'Basic Sknll s in 
Washington, D.C. The purpose of the National Conference was to bring 
together te'achers, educational administrators, testing, experts, local, 
state, and federal government officials, tetnd parents and community represen- 
tatives to begin a national dialogue about the. role thapt achievement testing 
can play in Improving the quality of elementary and secondary education. 
Among the policy recommendations stated at the National Conference was-the 
need to encourage awareness of a broad view of American education,j a view 
in which testing, is only ope part of the endeavor"^ to promote appropriate 
expectations about the us'fes and limitations of tests and testing; and to 
involve a diverse constituency in di-scussions of issues and development of 
solutions. Among the implementation recommendations growing out of the 
National Conference was that the federal government should convene 
conferences and training workshops for the diverse audiences who are involved 
in or affected by tests and testing. • 'The Regional Conferences on Testing 
and Instruction, discussed in this report, are one^^response to these 
recommendations.' 

The' contract for developing and supervising the Regional Conferences 
oh Testing ancl Instruction was awarded to the Center for the Study of 
Evaluation (CSE) at the Graduate School of Education, l^nWensity of Cali- 
fornia at Los Angeles by the National Institute of Education (NIE). ^ 
The conferences were a project under Testing, Assessment and Evaluation 
of the Teaching and Learning Division of NIE- Each Regional Confer- % 
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. ence was intended to offer presentations on two major topics: .the uses 

7 

and limitations of tes-ting . and the function of testing as ft! tool in 
classroom instruction . Participants at each conference .were to consist of 
instructional /administrative, policy, and research personnel, as well as 
members of the local community. The conferences were intended to foster a 
collaborative approach to 'issues of testing and instruction, to provide a 
broad overview to sorDO of the major concerns in testing and instruction, and 
to attempt to translate* th-se broad concerns into issues and implicat^'ons of 
importance^to the particular region. 

To meet these goals, a series of two-day Regional Conferences oh testing 
and instruction was planned. The conference for each region was coordinated 
by CSE (aad^ a regional educatiohaT laboratory or agencies in cooperation wi,th 
the United States Office of Education Regional Commissioner. Sinte the NIE 
procurement specified only eight conferences, ty/o sets of regions were 
combined (Regions I and II, and Regions VII and VIII). The 'eight cj^nferen^es 
were conducted" during March, April, May, and June, 1979. In addition to 
presentations on the; major topics -of interest, each conference also ^.offered 
a sec(5nd set of agenda items specific to the region in which th^ conference 
' was being conducted. • 

After initial discussion with NIE representatives on the structure pf the 
conferences, CSE had' identi fied the following set of tasks to perfo-m: 

1) i-^entify regional agencies with whom tp coordinate effort 

2) o plan the "national" agenda, that is, the common theme for 

Day I of all conferences 

3) . identify a list of. Day 1 potential speakers, and contract with 

those selected by the regions 

4) identify the structure of the two-day agenda, e.g., how much time 
. ' in small groups, etc. . 
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5) provide liaison and assistance to regional agencies 

6) develop 4nd supervise sub-contracts for local conference 
acti vity 



7) develop invitation protocols- 

8) adapt and develop materials for workshop activity on testing 
and instruction 

9) approve regional agencies* plans for speakers and 
conrlerence structures ' 

lOj provide on-site assistance in training facilitators for 
small group sessions. ^ 

11) maintain contact with the NIE 

12) synthesize recommendations from the eight conferences 

13) prepare final .report ^ 

The CSE director discussed the conference activity with the laboratory 
directors when it was first suggested by NIE. Following award of the 
contract to CSE, each director was contacted to determine the^lab director's 
^ intention of participating, and to obtain the name of a staff person 
authorized to work with CSE on- tjie^project. ' 

Since the conferences were designed to be-resional, and since many of the 
laboratories ^operate Regional Service Programs, CSE a'TsB^soiisul ted with 
Ed Ellis, Assistant Director for Regional Programs, Division of Dissemination. and 
Improvement of Practices, of NIE, at a joint meeting of the Council for Educational 
Development and Research (CEDaR) Communicators and the Regional Service 
Program in Oregon, Fall 1978. Thus, two divisions at NIE, the Teaching 
^ and Learning Division, and the Regional Service Programs, were aware of the 
collaborative effort. 

As potential agenda items were discussed between representatives of CSE, 
the regional laboratories, and the NIE, draft versions of the two-day 
conferences were formulated. Reviews of these drafts were conducted to 
ensure that the flinal set of agendas would reflect the intent of the project: 
to design and conduct. two-day conferences on testing and instruction where 
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(1) the first day of each conference would be relatively constant and consist 
of major speaker presentations on testing and instruction, and hands-on 
activities on issues in testing and instruction; and (2) the. second day of 
each conference would continue these two themes but through a set of 
specific problems and issues important to each region. ^ 

A set of tasks was developed which provided the core requirements for 
regional subcontractors. \ 

Each regional agency was to: • 

S 1) coordinate with appropriate Office of Education Region and 
Chief State School Officers 

2) specify preferences for Day I speakers 

3) implement invitation protocol to assure representation 

of appropriate gf'oups ' - c 

4) select site and coordinate on-site activities, e.g.j room 
arrangements, luncheon^ 

5) plan with assistance from CSE the Day II agenda 
6') prepare pre-conference announcement 

7) provide facilitators for small group activities 

These. tasks were to be implemented with ass'^stance from CSE and the 
National Institute of Education, 

The educational or other kgency sponsoring a Regional Conference, the 
United States Office of Education region represented, locations and dates .,of 
conferences, and the designated laboratory/agency liaison were: 
\ 

■\ ■ Conference Designated 

Laboratory /Agency Region Location Dates Liaison 

Central Midvyestern ^ V Qetroit, MI. Mar. 27-28 James Winters 
Regional Educational 
Laboratory ' 

Northwest Regional - X Vancouver, Apr. 30-May 1 Beverly Anderson 

Educational Laboratory WA 

' <^ . ^ 

Midcontinent Regional VII-VIII Kansas City, May 7-8 Linda Sikorski 

Educational Laboratory MO 
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. Laboratory/Agency Region 

Fanvest Regional - IX 
Educational .Laboratory 

o , 

Research for Better - III 
Schools 

6 

The Network I-H 

Southwest Educational VI 
Development" Laboratory 

Southeastern Regional TV 
Consortium 



Conference 
Location 



I 



Dates 



Los Angeles, CA May 14-15 
Haverford, PA Jun. 4-5 



Boston, MA ■ 
Houston, TX 

Atlanta, GA 



^Jun. 11-12 
Jun, 21-22 



Designated 
Liaison 

Lynn Jenks 

Marcie Sachs 

Clare Durocher 
Hardy Murphy 



Jun. 25-26 Jack Cook 



Conference Organization 

Certain , principles were agreed upon by the CSE staff, the NIE project 
officers, and the directors or coordinators in the regional agencies. In 
brief, each conference was intended to: 

1) provide a basis for a discussion of the uses of tests in schools 

2) provide a basis for discussion of the relationship of testing to 
instruction 

3) provide a regionally-relevant agenda ^ < 

4) provide an introductory trait^ing experience in the. development 
and use of tests to improve instruction . 

5) provide a forum where' representatives of federal, state, and 

. local educational agencies could meet with public school teachers 
and with university personnel to consider the issues involved in 
testing • . - 

6) elicit feedback from participants regarding needed research, 
development, or technical assistance in the area of testing 

In an attempt to reach the intended broad constituency, invitational 

protocols were designed. These protocols were intended to ensure that 

participants would consist^,of approximately 50% instructional staff, 25% 

administrative personnel at school and district levels, and 25% governmental 

and. conriunity representati Yes\ Each conference was planned to accommodate 

approximately 200 participan^ts. 
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CSE's resp^sibility in the planning and design of the conferences was 
to formulate all the presentations and activities of the first day. Thus,-' 
CSE provided each regional sponsor with a suggested^\i st of .nationally 
recognized experts in the areas of testinq'^d instruction. Each region, 
with one or two exqgptions, invited a speaker from the CSE suggested list to ° 
address the testing theme and the instruction theme. In the- case of the^ 
exceptions, either a suggested speaker initially selected by the region was 
not available,^ or the regional staff suggested a speaker not on the CSE list. ^ 
These latter speakers were chosen because of their fami 1 iarity with regional 
conceriris and because they had previously worked with and established rapport 
with the regional constituency. (A list of invited speakers on testing and 

instruction appears in Appendix A..) tfl--a(-d444:.ioa^_J_t was agreed that CSE 

was responsibfe for providing practice acti'vities on the themes of testing ahd 
instruction during the afternoon of the first day of each conference. Training 

*of staff, as necessary, to conduct these afternoon sessions was a joint CSE- 
regional agency responsibility. 

Sessions designed for the second day were to address, through speakers, 
special interest groups, and panels, topics under testing and instruction of 

.'particular interest in the region. It was planned to enlist speakers from 

•within the region for each second-day topic or issue. 

In addition, regional sponsors were responsible for providing a mechanism 
to elicit local recommendations about issues and implications in testing and 
instruction. 

General Schedule for Each Conference 

— \ 

The first day of each conference generally consisted of Introductory 

remarks to set the scope, focus, and intentions of the conference, usually 



made 'by the regional sponsor, i.e., l,aboratory director. These Introductions 
were followed by presentations on the major themes of testing and Instruction. 
The major presentations were summarized by a CSE staff member to reiterate 
their major points, to provide a bridge to and focus for the afternoon 
training activities, . to'begin the process 6f establishing the regional flavor 
of the conference, and to initiate thinking on the need to address regional 
recommendations and implications. 

Afternoon activities consisted of small ^jmtJp"a"c^vity on issues in 

"... ■ \-a 

testing an'd instruction. Participants broke into small groups and, 
facilitated by CSE and regional staff, discussed morning presentations and 
were oriented to materials of relevance to test development/selection from 
the standpoints of instructional sensitivity and technical quality. Summaries 
of m&jor addresses on testing and on instnuclion and description^ of CSE 
materials are presented in the next two inactions of this report. ^ 

Second-day acti vi ties 'focused pn the major issues in a manner deemed 
appropriate to the region, translated issues into regional questions, and 
elicited a set of recoim)endations. Regional recommendations are discussed 
elsewhere in this report, and all conference agendas are presented in 
Appendix B. , 

Follow-up to the Conference Activities Extension of Orijjinal Contract 

As previously stated, the Regional* Conferences were intended to stimulate 
a broad view of American education in which testing Is seerf as only one part • 
of that endeavor. Further, the conferences were Intended to develop real- 
istic expectations about the uses anjd limitations of tests and testing and 
to Involve a diverse constituency In dialogue about the issues Involved in 
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tests and testing and possible means ^of solution. / 
As a springboard for such dialogue, each regional conference presented 
an invited speech on testing* uses and limitatibns and an /Invited speech on t^he 

^ A 

uses of testing information in instruction. These talks provided a bridge 
for the introduction oK training materials addressing questions of test 
development and selection. 

At the conclusion of the contracted worS: associated with planning and 
conducting the Regional Conferences, CSE proposed a no-cbst e^xtension of 
work to; the National Institute of Education.' This extension was designed 
to meet two broad purposes. First, CSE would produce a^book W readings 
based on the invited speeches on testing and instruction. Second, CSE 
would revise thetraining materials on test development and selection on 
the basis of external review (these materials had already been somewhat 
modified on the basis. of pre-conference try out and their rec^eption during 
the Regional Conferences). Preparation of both the book of readings and. 
the revised training materials were intended to continue the kinds of /dia- 
logue begun at the Regional Conferences and to make the results of such 
dialogue potentially ivailable to teachers, administrators', theorists, 
researchers, and policy makers. 

The y/ork associated with this extension took place between April and 
August, 1980. , . 

The Book of Readings 

A total of eleven invited presentations resulted from the eight Re- 
gional Conferences (some speakers were Invited to mak$ presentations at 
more than one conference).. CSE tasks associated with producing a book of 
readings from these Invited presentations were as follows-: 
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. to edit the invited speeches, prepare transitional materials, 
-and have the edited presentation reviewed by the authors 

. to subject the edited papers to external review * 

. tO' revise the matc^ifials as necessary 

. to prepare materials for potential, commercial publication 

The effort required.^y CSE to edit the papers varied widely among the 
authors. In some cases, invited speakers had prepared draft papers; editing 
of these papers primarily required the kinds of changes associated with copy 
editing consistency of prose style, tone, point of. view, grammatical and 
syntactical considerations. Ipijsome cases, speeikers* presentations were less 
formal and relied primarily notes . In these cases., editing required by 
CSE stafff was extensive. This work involved transcribing taped presentations 
altering style, and delivery patterns into a form appropriate for "formal book 
publication, writing transitional pieces between sections of the speech, 
writing summaries, and so forth. In a few cases, speakers made informal 
presentations on the basis of their previous work already in print. In one 
case, t^hiT^ind of^ presentation cut across more than one earlier paper by 
the author. For 'the sp^eeches presented in this mode, OSE editing was again 
extensive and, in effect,/ amounted to large amounts of writing and/orVe- 
writing for consistency and appropriateness for the audiences envisioned for 
the book of readings. 

All edited papers were sent to« aut]}Wi§^for review and approval. At 
'the same time, CSE staff wrote^intpoductory materials for the draft book of 
'readings, a concluding section. 

The edited papers were reviewed by Bernard McKenna of the NEA. Final 
revisions were made and the volume now stands, ready to be considered for 



commercial publication. 

The Revision of CSE Training Materials 

As will be seen "in a later , section of this report, the CSE materials on 
test selection and development had already been subject to^ fev4sTon on the - 
basis of local try-oi/t and. feedback from the earlier Regional Conferences. 
It was felt, however, that the materials, ^given their potential use by and 
effect upon classroom teachers, should be viewed by external experts. CSE 
tasks associated with Revising the materials consisted of the following: 

. field test 

. revision 

. external review 

final manuscript typing. 

Judah Schwartz of MIT reviewed the draft materials in terms of their 
methodological soundness and the relevance and accuracy of^the domain spec- 
if i cation examples they provided. Bernard McKenna of ^ the NEA reviewed the 
materials from the standpoint of classroom application — are they potenti- 
ally useful to teachers? are they sufficiently broad to allow users to con- 
sider development of a wide variety of assessment techniques? are exemplary 
materials relevant and accurate? In addition, both external reviewers ex- 
ami'ned the leaders* guide accompanying the materials. Concurrent with these 
reviews, the materials were tried-out with teaching and central office Sycaff 
of a° local school district. 

After the reviews, and the local' try-out, the materials w^e subject 
to a final level of scrutiny. — this time by CSE staff with a background in 
tests and tes-ting and who represented classroom teacher experience and con- 
tent knowledge In tNe skill areas dealt with in the materials. 
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These CS,E staff (1) independently of each other and of the external 
reviewers provided detailed critiques of the materials and made suggestions 
for revision; (2) examined the results of the critiques made by the external 
reviewers; and (3) n^de appropriate changes to the training materials and 
to the accompanying leader's guide. All changes are nowo'ncorporated in 
the final version of the materials- CSE is presently considering appro- 
priate means of disseminating these materials; for example, it may be that 
a commercial publisher interested in. the book of readings would see value 
in appending practical test development/selection materials with. the read- 
ings on testing and instructional issues. ^ 

. Summari-es bf the invited speeches and CSE training materials appear 
in the next two sections of this report. 
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SUMMARIES OF INVITED PRESENTATIONS ON TESTING AND INSTRUCTION 

n 

As mentioned previously, each Regional Conference offered two major > 
presentations during the first morning, one orf testing and one on instruc- 
tion. Speakers on testing frequently discussed tests from %he standpoint 
of their uses and misuses. Speakers addressing instruction often dis- 
cussed the instructional implications of testing.- Since the speakers 
usually differed from conference to conference, and therefore the parti- 
cipants across all sites did not have the opportunity to hear the total 
range of issues offered by all major speakers, summaries of their 
presentations are included here, organized by the invited topics of 
testing and instruction. 

« 

Presentations on Testing/ ^ \^ 

•1. Ron Edmonds 

Ron .Edmonds is Senior Assistant to the Chancellor of Instruction, 
Board of Education of the City of New York. In his talk on testing, 
Edmonds' major concern was with the organization and administra- 
tion of schools to lead to a more equitable distribution of basic 
skills; 'he believes that schools cannot' proceedvto equity until they 
respond to.those students presently getting the least from education. 
In Edmonds' estimation, current norm- referenced testing practices have 
too great a hold on American schools, and that hold is the greatest 
single impediment to the^equitable provision of the goods of education 
~ parti cul-arly in the drea of acquisition of basic Skills. Part of the 
solution strategy offe|^ by Edmonds involves the local generation of 
criterion-referencerf tests, , ^ ' I ^ 



Edmonds sees four major Impediments to solving^ the probleip of test 
misuse vis-a-vis the equitable delivery of basic skills: (1) educators 
and others are too timid, too slow, and/or too indifferent to Instructional 
equity; (2) there 1s a great need for more rigorous analysis of test. uses 
and' abuses; (3) public understanding is modest and misunderstanding so 
pervasive that there is a great need .to inform the public before improve- 
ment can take place in testing; (4) the vested interest of the commercial 
testing industry. . \ 

Edmonds is aTso concerned with the interaction between pupil perfor- 
mance and family background. He- believes that'pupil family background in 
itself is not the principal determinant of achievement, but rather how 
^^chools respond* to that background. Discussion of this kind of issue is 
the first step in the consideration of instruction and test content and 
t)T| kinds of items developed to measure desired skill's. Such discussion^ 
should foc^s on school organization and administration, so that schools 
becememore democratic and equitable in what they deliver. 

Edmonds' approach tQ the use qf criterion-referenced tests calls * 
for public discussion of what parents and others want children to know 
and be able to do to demonstrate^cquisitton of basic skills. This 
public discussion must involve examination of student Instructiona"' needs 
and scrutiny of the measures to be developed aild the outcomes they 
will tap^After resofutlon of these instructional and testing issues, 
schools should consult the professional test maker to guide local 
development of measures that are technical 1^^ sound, instructional ly 
relevant, and responsive to the- results of the public needs sensing. 

Locally generated criterion-referenced tests can provide schools 
with information that is very useful in the attempt to deliver basic 
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t skills totm^t^ more students than is currently taking place. One role of 
criterion-referenced tests in this regard is to provide families of students. 
? with a basis to discuss with schools the acquisition of basic skills; 
these ^tests would provide a description of pupil progress in relation to 
what their parents want therfi to know. That is, schools need to become inore 



equity oriented; criterion-referenced test results. can be used to involve 
parents in this mov&ment. 

With the use of criterion-referenced tests as defined by Edmonds, 
three defensible purposes of testir^g emerge: (1) to judge the instructional 
effectiveness of the school building to distinguish between schools that 
are and are not instructional ly effective; (2) to report individual pupil 
achievement not in a normative mariner, but in terms of what the student 
currently knows); and (3) ^to report -individual pupil diagnosis and design 
instructional prescription that will improve the diagnosed deficiences. 
2. William Coffman 

William Coffman is Director, Iowa Testing Programs, University, of Iowa, 
One of f\is major concerns is that the pui^Vic is very interested in getting 
a simple answer td the question of how well their schools are doing. Since 
standardized tests are standardized,, they ought to be able to provide that 
simple answer. However, interpriiting test 'results is not^'a simple job. 
When they are faced with a choice between having test results that are 

misused and having no test resuilts, teachers will generally opt for no 

\ J 

test results, as is currently evidenced by resolutions for a moratorium. 

Coffman suggests thatkhe greatest error made is to assume that 
because standardized tests carry impressive technical manuals, and have 
names that appear to focus on desirable learning, they are mOlre accurate and 
relevant measures than they actually are; that is, that they are more 
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valid and reliable than they fctually are. By way of example', Coffman 
cites the Iowa Te^t of Basic Skills (ITBS). Its reading comprehension 
subtest is reported to have* a reliability of approximately .85 when used 
at a particular grade level- But the standard error of fpeasurement 
reported -in the test manual means th:at the reported score for a pupil 
may diffet by several units either->waiy from the true score one would ob- 
tain^from averaging many different' tests I'ike the ITBS but with different 
questions. The difference between v reported score and true score may/ljBad 
to students being place's in too low or too high a percentile rank.^ It 
takes considerable experience to be able to treat -test scores as indicators,' 
as useful information in the context of other information one. might have 
about 'a pipil. Yet it is probably better practice to have periodic test 
reports than to d§pend entirely on subjective impressions, especially if 
*one has the results-of other tests in a comprehensive battery as additional 
checks. 

Still citirvg the ITBS,-Coffman then discussed its language subtests -~ 
spelling, capitalization, punctuation, and usage. The composite based on 

these four subtests has a reported reliability considerably higher than the 

> 

reading comprehension between .90 and .94 for the typical grade with 
estirtiyfes of standard error of measurement ranging between 2.0 and 5.6. 
therefore^ one can oblain a relatively more accurate estimate of the ability 
of a pupil to answer multiple-choice questions about the mechanics of 
English composition than about the same.pupiTs ability to answer questions 
about passages read. But Coffman raised the question atjout how much can be 
said about/a pupil's ability to express thoughts in. writing on the basis 
of scores on the language subtests. . 
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The pro±)lem(of reliability is less severe when one loqk's at average 
scores for a class or school rather than at scores for individuals. How- 
ever, by foqpsing on output only and by ^assuming that the test is a 
comprehensive and valid measure of whatever it^is named, test results 
xan be misused. A school with below average test scores may be doing an 
excellent jcfb, while a, school with above average^ scores may be doing a 
mediocre job. Thj,s problem often leads to use of pre- and post-mea^sures to 
.determine which .sc'hodl s have the greater gains. However, given the, con- 
^derable, er-ror in any standardized test score, the gain sc^es derived 
from testing at the beginning and end of a pe.riod of instruction reflect 
the errors of both measurements and thus become even less dependable 
than the test scores themselves: - 

• A 

Coffman /then turned to discussion of the USOE guidelines for the 
evaluation of Title I programs. These guidelines, he suggests, are strong 
on statistical manipulation and weak of validity. Each of the three Title 
I models rests on assumptions which are not likely to be met in the situa- 
tions in which the models are applied. For example, one model assumes that 
the national norms for d test are appropriate references against which to 
compare a T.itle I program. The appropriateness of this comparison, however, 
c&n only be made by local educational authorities who are knowledgeable 
about local objectives and informed about what particular teaching, learning, 
and other contextual activities are occurring at the local Title I site* A , 
second model calls ^for the identification of a comparable group of pupils 
with which a group receiving Title I treatment can be compared. The experi- 
mental comparison required by this model is usually not feasible in education 
The third model assumes that the^performance of pupils i^n'^a school not pro- 
vided with Title I treatment Is adequate as an indicator of what would be a 
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reasonable expectation if no Title I treatment has been provided. While 
the analyses emanating from this model may look impressive, again the 
underlying assumption is usually not met and so the conclusions are usually 
invalid. 

Coffman points out that we should not attempt to draw conclusions from^ 
such comparisons on the basis of test scores alone without applying pro- 
fessi.onal judgement to make adjustments for the effects of variables assumed 
to be controlled and which usually are not. 

In terms of criterion-referenced tests, Coffman believes that their 
advocates seem to suggest that such tests avoid all the problems of validity 
and reliability encountered with norm-referenced tests, a supposition he does 
not accept. In this regard Coffman raised issues of objective focus, setting 
standards or cutoff scores, and number of items^ answered correctly to infer 
mastery. Coffman feels that any good achievement test should be a sample 
from some criterion domain and that, instead of comparing norm- and criterion- 
referenced measures, we should be concerned with the breadth or specificity 
of the domain and with whether the interpretation of the score is norm- 
referenced or criterion-referenced. With a norm-r'eferenced interpreta^tion 
we need to ask how good is the obtained score as an estimator of the true 
score of the pupil on the developmental scale used for reporting. With a 
criterion-referenced interpretation we need to ask what is the probability 
that we. have classified the pupil correctly or incorrectly. 

Coffman concluded by addressing the minimum competency moveinent.^ He 
feels that funds being spent on the development and operation of minimum ^ 
competency testing programs might better be directed at efforts to understand 
how to work effectively with children who are not learning at a normal rate. 



He believes that ours^rrent problem is not that educators cannot 
identify deficiencies, but that it is difficult, to know how to solve a 
particular learning problem. 

By way of summarizing Coffman -of fered the following points: 

1. tests are professional tools that are not to be treated over- 
simplistically ' . ' 

2. tests are indicators to be used as guides to judgements; they 

are not substitutes for professional judgement * 

3. both norm- and criterion-referenced interpretations of test 
scores are useful and informative and should not be set up 

as antagonists ^4 

4. there is a major task of educating people to what tests can 
and cannot do , , *^ 

3. Peter Airasian 

Peter Airasian is Pigo/essor of Education, Boston College. In his 
presentation, Airasian provided a perspective in which to place current 
^ debate over uses and.misuses of standard^ized achievement tests. He defines 
an achievement test as a sample of behavior that is used to make ififerences 
about a larger domain of behavior. On the basis of this sample of behavior 
inferences about how pupils would perform on the larger domain are made. 
Three points of interest emerge from this definition of a test. First, when 
we examine the content validity of an achievement test byxomparing the 
objecti-Vits---af in^s^truction to^^^^^ items in the test, we are asking whether 
there is sufficient correspondence between what was taught and what is being 

tested to permit valid inferences about pupil learning. Second, no test 

"i • 

provides an exact inference about a pupiVs performance on the larger domain 
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of interest; because a test is a sample of behavior, the results of. a test 
are subject to error. Third, the word "tesV' is a geneVic term, encom- 
passing not only standardized tests, but also other educational situations 
in. which a sample of behavior is used to make inferences about an individual's 
or group's diaracteristics- Many so-called alternative assessment procedures 
such, as pupil interviews and' examination of work samples are also tests. 
IJhile they differ from traditional norm-referenced tests in form and content, 
as well as in the way results are presented, they are nonetheless test^. 

Airasian sees the social' context of schools and classrooms as tes-^ing 
situations with or without the" introduction of standardized achievement tests. 
Even if standardized tests were eliminated, a great deal of testing and 
inference making would still go on^'n schools and classrooms. But this is 
quite proper, since one of the primary roles of a teacher is to guide student 
learning, and this' cannot be accomplished without testing in one way or 
another. It is therefore simpl istic for critics of standardized tests to 
argue that with the abolition of such tests will emerge classrooms not con- 
cerned with testing or inter-pupil comparisons. 

With this background information given, Airasian then turned to arfeas 
in which standardized achievement tests have been criticized. These kinds 
of criticisms can be presented in terms of three general areas^s They are 
criticized on the basis of characteristics intrinsic to the tests; that is, 
on the basis of what the tests are or what they measure. They are also\ 
criticized on the basis of characteristics not intrinsic to them; that is, 
on the basis of what they are not or do not measure.^ Lastly, they are 
criticized on the basis of what they do; that is, on the basis of their 
effects on pupils, teachers, and the educative process in general. For 
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example, criticisms related to c{iaracteristics intrinsic to the test 
/ might be that standardized achievement tests mean that about half the 

pupils tested will be below average; or that stanJardized tests measure 
only a small portion of 'what teachers and schools try to do. ''Exarjiples 
of criticisms related to characteristics not intrinsic to the test might 
be that standardized tests are not diagnostic, ^or that they do not 
measure creativity, interest's, initiative, values. Examples of criticisms 
'>elated to the effects of tests might include that standardized achieve- 
** ment tests label pupils, mislabel pupils, that they dominate school 
curriculum, or that they foster competition in the classroom. 

^But there are anomalies among these kinds of criticisms. First, 
' standardized tests are criticized because they measure a limited and 
trivial dimension of the entire pupil. The same tests are criticized by 
others because they me'asure too broad a range of pupil characteristics. 
Second, many of the criticisms concerning the characteristics which tests 
do or do not possess may be overcome in' practice by 'the informed selection 
of tests in the first place. Third, given that any test is a sample of 
' behavior might be taken as an argument for using more tests to measuV^ 

additional areas rather than as an argument for abandoning standardized 
achievement tests altogether. 

Airasian then offered four actual misuses of tests to consider- First, 
it is a misuse of standardized achievement tests to treat -scores as if 
they were an infallible, unchanging index containing to error. Any test 
score contains error, insofar as it is impossible to say with certainty 
that the iVidividuaV s- observed score indicates his or her '•trufe" performance 
on the general domain to which we wish to make inferences. 



A second misuse occurs when a single test score is used as the sole 
criterion for making important decisions about individuals and programs. 
Test results should always be interpreted in light of various contextual 
parameters which characterize the pupils, teachers, and the genera.1 school 
environment. 

A third major misuse of standarized achievement tests occurs wKen ^ 
uncritical 'assumptions are made about the traits that a test is presumed 
to measure. Just because a test has the word achievement in its title 
^oes not mean that for all pupils in all situations the test taps only or 
even exclusively achievement, for some groups, depending upon the natare' 
of the instruction they have received, the test may not be a measure of 
school achievement at all, but rather a surrogate measure of verbal 
fluency, home background, or social status. 

A fourth misuse of standardized achievement . tests occurs when the 
information provided by a test score is confused -with interpretations of 
wheft^.eaused the behavior to be summarized, by that score. A test score is 

a numerical description r)6vther gobd nor bad in its own right but only 

• \ 

when it is interpreted in terms of some judgmental criterion; it provides 

.an estimate of an individual's performance at .a given point in time; it 

ft 

does not tell us why the individual perfoniied as he/she did; it represents 
an abstraction from the contextual parameters which might relate to or 
Influence it. 

No single test, given at any sirigle time and divorced from consider- 
ation of contextual contingencies, should serve as the sole criterion for 
making decisions or providing , explanations of pupil behavior. Within the 
classroom, there is one primary use of standardized achievement tests. 
They provide an additional source of evidence about pupils which teachers 

f 



may use to corroborate their own judgements and perceptions about pupil^. 
Of ten,, test results will tend to ag»*ee with teacher judgements; where $^ey 
do not, a flag may be raised to suggest further consideration of particular 
pupils. ' ; 

4. William Angoff 

WiTlia:!! An^qff is the Executive Director for Technical Development at 
Educational Testing Service. Although many of his remarks were set in the 
context of the history of s^^ardized testiaa in the United States, his 
presentation did deal with aspects of test use and misuse . For example, 
Angoff believes that standardized testing, when used properly, is an indis- 
pensible tool in a democratic society in which large numbers of young people 
seek to advance themselves educationally, socially, and economically, and 
thus are asking to be evaluated as individuals without social, ethnic, 
national, or religious labels entering into the evaluative process. The 
four principal characteristics of standardized tests described by Angoff 
in this regard are their accuracy, objectivity, standardization, and 
comparability. Even though itest scores are imprecise Angoff believes that 
they are. still better than alternative devices such as subjective marks and 
grades, interviews, recommendations, rating scales, and oral examinations^^ 
"No matter the indisp^nsabili ty of these alternative approaches, they, ar 
far less precise than we would like tp believe and far less precise than 
standardi.ied tests. Standardized tests, he maintains, still remain the 
most accurate measures we have. 

On the matter of objectivity, Angoff believes that the kinds of 
, alternative approaches to assessment l.isted above are subject to human 
bias. While standardized tests are susceptible to possible bias, if they 
are used as they are intended to be, they are free of bias. At the very 

3 




ERiC 22 



least, they are free of the contamination that arises from prefformed biases 
that creep into any evaluation of one human being by another. 

Angoff cites the fact of standardization as the principal character- 

« 

Istic of standardized tests* Such testing is conducted under carefully 
controlled conditions, the scoring is done in precisely the same way for 
all examinees, raw scores are converted to scaled scores by means, of the 
same conversion t^ble .for everyone* 

Finally, Angoff c>t€d comparability as one of the most significant 

developments in the field of standardized testing; that is, the statistical 

<j ^ 

technique of score calibration which makes it possible to make valid com- 
parisons between and among individual students and groups of students. 
Further, the same techniques of calibration allow us to combine data in 
various /Ways and make it possible, for example, to make comparisons across 
years and to plot and observe trends. 

cWhile tests fiave a useful and important place in American education, 

.J? 

it is easy to overemphasize their value and make the mistake of placing 
too much reliance on them: tests are not perfectly accurate, they are not 
perfectly predictive, they do not measure the whole person, they do not 
measure native or innate ability, they do not measure the human potential, 
they do not compensate f£)r unequal preparation or opportunity in previous 
expos-ures to education. On the other hand, standardized tests are more 
versatile, more useful, more objective, and much fairer than any other 



method we know for assessing human talent acid abilities. Hojwever, they 



f 

are not a panacea and should never be used' in isolation to make important 
decisions when additional information is available. 
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5. Frank Womer 

Frank Womer is Director, Michigan School Testing Service. Womer 
defined a test as a ^data gathering set of activities, artd discussed the 
basic ways in which inferences about .the meaning of a test score can be 
made; he defines the norm-referenced application as the attempt to make 
- accurate comparisons of the performance of one student with other like 
students how a student ranks with his peers on the given set of questions 
used in the test; heNiefines the criterion-referenced application as the 
attempt to relate the teH^^^cor^^f a student to some desired test score 
a desired test score being a standard that is deemed appropriate or even 
essential for students in a given grade or a given age. 

Womer then described specific uses and abuses of tests as falling 
readily into one of three categories planning how to use test results, 
the testing (using) phase, and the actual interpretation. 

Under/^irtTBy ^pl^nning phase , Womer^scussed the following issues: 

Looking for information vs. looking for answers : Test scores should 
be seen as specific bits of information aboyt performance on a test. They 
can be related to other kinds of information known about a student to add 
interpretative capability to the test score itself. A test score does not 
provide a set interpretation. > 

Looking for information vs. justifying prior judgements : Even worse 
than assuming that a test score equates automatically to a given answer is 
the situation in which a test user is concerned primarily with seeking. test 
scores that confirm prior decisions or opinions. 

Developing standards vs. borrowing standards : It is unwise to use 
test norms as test standards automatically; yet many consumers of test 
scores tend to set average performance as the expected standard for everyone. 



Rather, attep.pts should be made to set standards of expected or hoped-for 
attainment independent of test norms. 

Identifying needs vs. categorizing : To assume a student will maintain 
an undesirable level of competence on the basis of a low test score ignores 
the great variations in opportunities and motivation to learn specific cog- 
nitive skills and to practice these skills. Test score? should be seen a^ 
a challenge for improvement rather than as an impediment to improvement. 

Judging ef f act i verges s of learning vs. judging effectiveness of instruc- 
tion ; All achievement tests are designed to measure whether students have 
or have not learned something. But the test score^they provide does not 
indicate the manner in which a child learned the skill or the conditions 
under which the skill was learned. 

Under the using phase, Womer discussed the following kinds of issues: 

Ascertaining what a test measures vs. assuming what a test measures : 
A test's title rarely describes specifically what is being measured in the 
test; it is therefore unwise to assume the test title will provide sufficient 
information either to select a test for instructional appropriateness or to 
interpret the results it provides. 

Testing for individual need's vs. lockstep testing : Although group 
testing may be an essential ingredient in a testing program, it needs to be 
tempers with more individualization of testing than now exists. Teachers 

may not \ee the values of test results from a .Systemwide testing program 

1 

nor be able to use th4m for their own instructional purposes. 

♦ 

Using repeated test measures vs. using single measures : It is unwise 

and dangerous to draw sweeping generalizations from single test scores; 

three or four test scores from different tests or alternate test forms 

taken some time apart may provide more reasonable evidence of a typical 

^ .evel of student functioning. 
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Understanding th^ n.turp of deri ved scores vs. superficial understanding: 
Misundorstanding and misuse of such connonly used test scales as the grade 
equivalent or the percentile is a severe problem. Such scales provide infor- 
mation about the ordering or ranking of scores and should not be used to draw 
exact inferences about differences between scores. / 

Interpreting variability vs. interpret ing exactness: Since all test 
scores are subject to potential error, test users should interpret test 
results in a band around the specific score that a student obtained. Each 
test score should thus be seen as a range of scores within which a given 
student's attainment probably lies. 

Makin g testing subservient to teaching vs. dominating teaching; Achieve- 
ment tests should be tools designed to reflect the goals and objectives that 
teachers and others are attempting to attain. 

Under the interpreting phase, Womer discussed the following: 
Interpreting high scores vs. interpreting low scores : While there a'-e 
only a few different ways to get a high score on a test - to know the answer, 
to' guess, to cheat, there ape more different ways to get low scores - not 
know the answer, poor guessing, poor^mo'tivation, lack of exposure to or 
practice with the skills being tested, etc. Therefore low test scores need 
. not be penrmrjent evidence of low attainment, and unwarranted interpretations 
of low test scores represent a major misuse of tests. 

Sharing results with students vs. secrecy : If a test is really an 
infomation gathe'r^^' device then that information may appropriately be 
shared with students: e.g., to help the students know when they have - 
mastered something and when they need, further study. 

Needs assessment vs. certification of attainment : The results of 
standardized tests have been used for many years for purposes of demonstrating 
the levels of atta4nment reached by a group of students. But test results 

t 
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should also provide useful diagnostic information for the classroom 
teacher to help Identify learning needs of individual students. 

In summary, appropriate uses of tests can be maximized and abuses 
minimized If a test user- knows what he wants from test results, selects 
tests designed to give that information, khows the characteristics of tests 
and test development, knows the characteristics of derived scores used to 
report test results, and treats the resulting scores as information that 
has potential utility for improving the learning of both individual stu- 
dents and groups of students, 
6. Deborah Meier 

Deborah Meier is a New York City School principal. She 1s concerned 
that so many teachers, parents, and legislators do not understand the 
terminology qf standardized testing. The few terms that seem to be under- 
standable and useful, such as grade level, are actually misleading. Yet 
there is almost compVete »^el lance on formal test scores, even when they 
run counter to professional judgement of student competence. Given the 
great impact of test;rng on schools, and on teachers', parents', and chil- 
dren's attitudes toward school ing, tests must be scrutinized much more 




refully. 

To elaborate her position on formal testing, Meier used an auto- 
biographical and anecdotal approach, with examples of conflict between 
test scores and professional judgement. For instance, she discussed the 
third-grade child who had been an early reader but who scored poorly on a 
formal reading test. Observation revealed that this child thought the 
"fairest" way to approach the test was to read the passage, then cover the 
passage with his hand and try to answer the questions; that is, to see how 
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much of the passage he retained aftet- reading it. For this child, because 
of his interpretation of the task, the test was not a "reading" test. An- 
other example involved a kindergarten class Meier taught in Central Harlem. 
When the first of these children reached second grade, the age at which New 
York City begins testingXcMldr^that Meier had judged to be reading well 
scored poorly on the tests, ^ese disparities led her to be more critical 
in her examination of test content and form and children's perception of 
the nature of the testing task. 

Pursuing these issues as a teacher, Meier discovered many students who 
could read a passage with oral fluency, discuss it intelligently, and yet 
get the wrong answers on formal tests of its content. Some children gave 
answers based on experiences which, though reasonable, were not the exper- ^; 
iences envisioned, by the test makers; other children gave answers based on 
a logic the test was not designed to tap; still others chose a wrong answer 
because they misunderstood the task or the test directions. Again, for 
these children, the test cannot be considered a test of reading exclusively, 

Working closely with these children, Meier would read parages and 
their questions aloud; many of the children did not fare any better on test 
questions even when they were relieved of the task of reading. Their dif- 
ficulty lay not in reading as such but rather in dealing with content, rea- 
soning, or deciphering the nature of the task or the bias of the test makers. 
Seemingly simple passages on a second- or third-grade reading test have 
subject matter, a particular terminology to describe the subjejit matter. 



" and a particular way of demonstrating mastery. But even wh^n children were 
not puzzled by the subject matter or led astray by false but clever guesses 
about the meaning of an unfamiliar term, they still often missed the test 
makers* logic in selecting the one correct answer. 

Meier, then, is concerned about misuse or misinterpretation of the scores 
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derived from standardized achievement tests. These tests, designed to discrim- 
inate among certain kfnds of children, provide scores that are constant nation- 
wide; half the children will always be labeled below grade level and half 
tfbove, and so the demand that everyone read at or above grade level, using 
these test scores as criteria, is unrealizable. • ' ■ 

.This issue led Meier to consider the nature of bias in standardized 
tests. Test. makers need items that discriminate among learners on a statis- 
tically predictable basis'. They design items that will be answered wrong 
by certain kinds of children; and the same number of children in the popu- 
lation as a whole will answer particular items-.wrong as in the sample group 
on whom the tests were nonned. What matters, according to Meier, is not the 
absolute "fairness" or "accuracy" of the "right" answers, but their ability 
to distinguish the better students from the less able ones and in so doing 
^ produce a predetermined scoring pattern.. 

A reading test, for instance, will have items in which vocabulary, sub- 
ject matter, language style, metaphors, word and idea associations, and values 
assume a "mainstream" social and personal history. The child who has to stop 
and think about what these assumptions are will not do so well on the tests 
as the child for whom the assumptions hold. The tests thus provide a fairly 
accurate screening device separating children by their ability to handle 
"mainstream" culture from those who did not. The tests require a class an^ 
ethnic bias, and for reasons that are neither vicious nor prejudiced. The 
bias is simply a characteristic of this approach to measurement, but it must 
be recognized for what it is and what it produces. ^ 

Standardized tests produce a score that combines many traits. Including 
the ability to read. But they are not a very helpful measure of what the 
school can do to help children learn to take meaning from what they read. 
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If standardized test scores are confused with how a child reads, then ^11 
children are done a disservice, but the disservice Is most^serious for di:^- 
advantaged children It is therefore necessary to see/^ha^l^mitations of 
such tests, and use them sparingly and only when the information they pro- 
vide is the information needed. 

We need to admit that we have only imprecise ways to measure children's 
skill at something as deceptively simple as "reading." Our formal tools of 
measurement are no more objective or accurate than techniques in which a 
teacher listens to a child read a selection and then questions the child 

I 

about the selection. Teachers and parents alike need assistance in under- 
standing and accepting the diagnostic richness of these techniques. Nothing 
is more harmful to a good education; than the present ferosion of the capacity 
to make judgements, to have personajl standards^ Formal testing must be 
returned to its proper place as a minor adjunct of education. Perhaps 
then schools will be able to devot^ the time and effort needed to deliver 
equality and quality in education.' 

\ 

Presentations on Instruction \ . \ . ' 7 

I- \ 

1. Eva Baker k^^- 

Eva Baker is Director of the Center for the Study of Evaluation and 
Professor in UCLA's Graduate Schocjl of Education. Baker explained the 
current positions about testing as a function, in part, of the history and 
background of testing: tests have been used as or claimed to be use\ as an 
instrument fostering competition; the growth in testing technology has been 
continuous; the great belief In the psychological virtues of testing; and 
the great and varied claims about what tests can legitimately be used for* 
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Among these widespread claims are that tests provide useful Information ^ 
for decisions about student selection and/or program selection; to make 
decisions about classroom instructional practice; to permit comparative 
descriptions across schools; to provide useful information to a wide 
variety of concerned audiences; to make decisions about students' college 
entrance; to make decisions about teacher certification and/or evaluation; 
and that tests meet many mandated requirements for information about 
students and educational programs. 

Given the apparent widespread use of tests, Baker is also concerned 
with determining how much testing is actually taking place; how much of 
the information provided by tests is actually used by teachers, to what 
extent the use of test information has an effect upon students, programs, 
and teachers; how much testing takes place not for the purpose of educa- 
tional decision making but rather to satisfy external demands for infor- 
mation. 

Should testing continue, Baker is also concerned about questions of 
which kinds of tests provide the most useful information -and for whom, 
how much testing should take piace, and the extent to which test infor- 
mation can be used to improve school'decisions regarding equity issues and 
student competence. 

Baker also pointed up areas of irrationality in -current debate over 
testing. '^On the one hand, there appears to be a great belief in the quality 
of tests developed by experts who are external to schools; that the tests 
developed by these experts provide a match with 'a given curriculum (a cur- 
riculum which may also have been developed by an 6u tside 'expert ) ; that the 
information generated by tests'' Will be used by« teachers and schools to modify 
instruction. Oh the other hand, CSE work and other researchers have pin- 
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pointed many weaknesses, both technical and instructional , in norm- and 
criterion-referenced tests currently in use. Commercially made tests, 
both norm- and criterion-referenced, vary on technical quality as well as 
on their^appropriateness to the local curriculum. Teacher-made criterion- 
referenced tests may be locally responsive and have greater instructional 
relevance but can often be challenged on technical questions. Further, 
teachers do not appear to have great faith in the values of testing. 
Teachers feel that tes^ts are imposed on them; they do not meet the realities 
of the cl assroom; . that tests often have a weak relation to instruction and 
thus' teachers rarely'rely on their results for instructional decisions. 
Even when teachers do attempt to tie test information into the^rsinstruc- 
tional decisions , they admit lack of knowledge about what deri ved^scores 
actually mean; the results are thus difficult to interpret and to relate 
to instructional^eeds and decisions. Finally, these problems are often a 
function of poor description of a test; a written description often be- 
fuddles the issue of what a test will supi^p^dly measure and the kinds of 
information the test user actually needs. 

Tests will not provide teachers with information for instructional 
decisions unless they meet the following kinds of design criteria: 

1. publicness -- test development procedures and test intentions must 
be made public; tests must provide sufficient clarity of description that 
teachers understand how to use them to make decisions about individuals 
and classes; students .need to know why they are being tested and exactly 
what is expected of them; parents need to understand test Intentions, 
results, and the bases of decisions affecting their children, 

2. economy — tests should be used more sparingly; they need to be 
more eco~"nomical , not only in terms of money, but. also in terms of student 
and teacher time and student and teacher anxiety. 



3. sensitivity -- tests must be directed to instructionally sensitive 

" r 

matters; they must be responsive to and lead to instructional intervention. 

4. . significance — tests must be meaningful; they must be of signifi- 
cance both to the students whp take them and the teachers who use them. 

V 

Even with the advent of these criteria, however, tests should only 
supplement, and never supplant, other kinds of information, such as teacher 
judgement, used to make classroom decisions. 

Baker does not suggest that teachers must become instant test develop- 
ment specialists. Rather she asks that teachers become more informed con- 
sumers of test information in terms of the decisions they make. Teachers, 
as Informed consumers, need to be able to ask the right kinds of questions 
about a particula*^ test: what kind of information doesl(jfhis test provide? 
what kind of scores does it yield? what kind of assistance will it provide 
for instructional decision making? what evidence is there that student 
performance can be improved on the basis of the test? what evidence is 
there that curricula e)^ist to facilitate the desired improvement? does the 
test help communicate expectations to students and parents? 

Baker proposes local test development as one means of improving the 
usefulness of tests. But whether tests Ir^e locally or externally generated 
they should meet the four broad criteria previously outlined. " Should tests ^ 
begin to address these criteria, it will be possible to develop a coherent' 
logic in test items. On the basis of that coherence, instructional needs 
can be identified and appropriate prescriptions made about what to teach or 
how to. provide additional , practice on an identifi^ed skill deficiency. Tests 
developed on this basis provide the first step in systematically tying 
together testing and instruction in the classroom. 
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2. Madeline Hunter 

Madeline Hunter is the Principal of the University' Elementary Schoal 
of UCLA. In her talk, she expressed concern- about the amount of testing 
currentTS^' taking place and the time it detracts from the task of teaching. 
She is also concerned that many students do not understand or accept the 
purposes of testing. 

Hunter further suggests that tfachers are not using the broad range 
of data that is often available to them, perhaps because of tension between 
the kinds of information they want and external demands for other kinds of 
information. Part of the confusion may be explained by examining, the pur- 
poses of evaluative and diagnostic information and the fact ;that they are 

intended to leM to different uses/conclusions. Hunter defines evaluative 

) - 

information as being judgmental, comparatiye, and typically summative and 

<!■ 

thus of little use to teachers in instructional decision making.. She de- 
fines diagnostic information as the principal aid to teachers in making 
prescriptive decisions to improve the performance of individual students, 
groups, and classes. In. this regard, further, standardized tests either 
provide^-too little information, or too muqh too late. Direct\ teacher ob- 
servation of students, she suggests, is the best source of diagnostic 
information. 

Hunter offers three approaches to diagnosis. These three approaches 
consist of: 

1. formal, standardized achievement tests 

2. informal diagnosis 

3. inferential diagnosis 

Formal testing may provide an accurate source of information, but can be ^ 
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time consuming and costly. The two other approacf^ed^ relying on teacher' 
observation of students and constant use of feedback while teaching, provide 
diagnostic information in a less costly, manner. In the case of informal 
diagnosis, .potential imprecision of information is offset by timeliness of 
the information in terms of allowing immediate prescriptive decisions 
during the act of teaching. But it iS' important that studertts understand 
the purpose of informal diagnosis; it is not intended to have a summative 
or evaluative function. Such diagnostic information, however, may need to 
be examined in terms of its relationships with the results of formal testing 
programs .( 

Inferential diagnosis can also be an effective source of information. V 
It draws upon prior experience '^ith and knowledge of the students being 
observed. Obviously, the comparability of the prior and present experiences 
is an issue in terms of reliability of the information generated. Both in- . 
formal and inferential diagnostic information can be used in conjunction 
with formal measures to corroborate instructional decisions. 

The kinds of decisions made on the basis of diagnostic information , 
will also be influenced in terms of issues of dependency/independency in 
instruction and learning. Not all learning occurs in a dependent sequence; 
in SQmp, learning areas sequences are independent. The importance of these 
two kinds of sequence [nust be understood in test data interpretation, since 
these data must be translated into instructional strategies on the basis of 
.student mode of learning (input) and verification of that learning (output). . 

Instructional strategies should* also address: 

1. the content decision of where instruction should begin 

2. student's optimal learning mode 

3. amount of teacher and student time needed to achieve desired 




Hunter suggests .that formal tests are not entirely effective in 
answering question number-'three about time; however, they Bay be quit^ 
effective in^nswering question number one on instructional Intry ind to 
tome extent In answering question number two about stydent learning 
■K)dality. To the.exte^^ that formal reasures have these properties, they 
may effectively corroborate teacher decisions made on the basis of class- 
room observation. There is no single* b6st approach to testing. 
3. Judah Schwartz 

Judah Schwartz is with the Educational Development Center and 
Massachusetts Institute of Technology. His talk on alternative approaches 
to, assessment has both test use and instructional implications. Schwartz 
described the history of the psychometric tradition in ^st development as 
a response to society's perceptions of its-Hieed for accountability and 
selection. He amplifies these broad^^es^n terms of accountability 
judgements about the quality of school systems, accountability or licensure 
judgements about the performance of Individual^^eachers , and the wish to 
detect and assess th^e effects of instruction for the purposes of diagnosis 
and treatment — i.e., to help shape the form of instruction. While 
accountability, .Selection, licensure, and diagnosis are all legitimate 
and necessary functions in society, there are reasons to question how well 
the psychometric paridigm can allow us to fill these societal functions in 
an enlightened and humane way.' 

• Schwartz's offers two broad classes of objection to the psychometric 
paradigm. The f-(rst is that multidimensional phenomena — for €xan»ple, 
traits, abilities, or behaviors —cannot be ranked ordered. Mell ordering 
is indeed a property of one dimensional attributes, but tiuUldinensional 
phenomena cannot be well ordered except when a theory of aggregation is 
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present. Under those circumstances It Is possible to aggregate complicated 
and diverse phenomena so that they differ from one another only with respect 
to the value of the .attribute In question. However, In the absence of such 
theory it Is not possible tb rank order the value of the attribute. 

The secortd class of objection to the psychometric paradigm Is the problem 
of validity. Psychometric Instruments' are almost alwaj^s^ validated In deriva- 
tive ways. And yet the validity of achievement tests as measures of educa- 
tional accomplishment are rarely questioned. Even In the area of criterion- 
referenced testing, little work has been done In establishing with clarity a 
possible meaning or me^inings for validity. The general methodological 
problem is still far from settled. In short, there Is still a great tendency ' 
to choose test items for their discriminating quality rather than quality of 
content. ^ \ 

Schwartz then introduced three interrelated questions dealing with 
detecting the effects of instruction and assessing the quality of those 
effects, either in terms of learning of Individual children or in terms of 
the effectiveness of programs. These are: 

• 1, how can'we best measure and analyze the effects of Instruction 
on students' learning In the major school subjects? 

2. what are the most appropriate times and strategies for measruring 
the effects pf schooling on student learning? 

3. what do we learn from means of assessment otfjer than standardized • 
achievenjWit^testing? 

Before discussing these questions, Schwartz first addressed sone of his 
own beliefs that Informed the ensuing presentation. First, Mny of the 
\things that can.be learned can only be measured through means of assessment 
that. do not fall under the traditional rubric of standardized, norm-referenced 
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testing. Second, competence, as i construct. Is not observable. But per- 
formance is> observable and so we probe competence via observed performance, 
and we make inferences about competence from our observations of the per- 
formance. It is logically unacceptable to hold simultaneously the view 
that performance implies competence and nof( -performance Implies non-compe- 
tence. If we accept the view that performance Implies competence, we make 
no inference whatsoever about competence in the case of non-performance. 
Third, he does not believe that the intellectual activity of people can be 
measured; people come in groups of one and are not statistically inter- 
. changeable. 

In. terms of his first question better measurement he offered a 
number of criteria. Among these criteria were: better assessment instru- 
ments must be flexible and must accommodate the idiosyncratic learning 

/ 

styles of different children; they must be as free as possible of cultural 
or ethnic or linguistic assumptions; modes of answering questions must be 
adjusted to be comfortable for the child; tests should have greater diagnostic 
value; they should be made public in their entirety. 

His second question when to assess —was discussed from the stand- 
point of flaws in the assumption that growing competence at some task is 
accompanied by better performance at that task. He cited research demon- 
strating the occurence of non-monotonic development in a wide range of kinds 
of learning; i.e., where the performance of students on^tasks on which they 

had just received instruction deteriorated as they attempted to bring into 

• . ■ * ^'^ 
consonance newly recognized dimensions of the task with those already 

mastered. He then raised the question of Implications of nonnponotonic 

development with respect to the Issue of optimum times to conduct assessment 
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and suggested that continuous rather than episodic assessment is the only 



way to avoid the problem of faulty inference^bf student competence based 
on a "snapshot" approach to a student's cognitive development. 

In terms of his third question what can one learn from ^alternative 
assessment techniques he is concerned that student performance on a norm- 
referenced test is always definecJ in terms qf> the performance of others and 
not in terms of the task itself, and therefore provides little in the way%f 
diagnostic information on the individual c-hild. Further, he described the 

multiple choice format used in most standardized tests as a crippling feature 

♦ ^ 

which does not allow for observation of a student's formulation of a problem; 
by not allowing the student to construct his or her own answer to the question, 
by forcing the student tO' choose among several formulations that the test 
maker has provided, we abandon the possibility of gaining insight into the 
child's own thinking about the issue. We need alternatives that capitalize 
on the student's own conceptualization of the domain. 

Among the gains to be made from alternative assessment strategies he 
cited: the ability to identify the weaknesses in the perfomance of "strong" 
children and the strengths in the performance of "weak" cliildr'en (strong 
and weak defined as a function of percentileratings) ; the ability to 
provide information about how next to proceed with individual children having 
difficulty with various pieces of an educational program and, as patterns of 
difficulty emerge- among groups of children, the ability to help teachers 
reshape group instruction to meet identified difficulties with their instruc- 
tional programs. 

4. Jan Barnett, Vicky Hardway, and Connie Myers 

Barnett, Hardway, and Myers are Practitioners In the Spring Branch 
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Independe'nt School District, Houston, Texas. Bamett Is Assistant Director 
of Pupil Appraisal Services; Hardway is a 4th grade ^teacher; Wytn is an 
elementary school principal. 

Barnett, Hardway, and Myers discuss the uses of criterion-referenced 
. testing as an 'educational tool. In their presentation, they argue their 
case from the general to the' parti^cular. In doing this, they provide a pic- 
ture of test development and the instructional uses of these tests from the 

standpoint o^the state, the district, the school., and a particular class- 

I • - 

room in the school . > 

The state position is that sdhools need measures of what a student can 
actually do, not just how he or she compares to others. "Assessments of 
learning competencies must include competency-based and/or criterion-refer- 
enced measures in addition to other types of assessment techniques." This 
charge requires the educational diagnostician to take into account a broad 
range of assessment information. Barftett et al describe the rational for 
such testing practices as follows: 

. to permit individual izat'ion of student programs 

. to demonstrate accountability 
' . to permit full utilization of instructional alternatives 

. to recognize individual student differences 
• . to provide instructional continuity 

. to make student mastery decisions 

Barnett et al discuss their district's decision concerning the develop- 
ment of tests to be used for the purposes enumerated above. District planning 
for test development was intended to produce tests that would be linguisti- 
cally fair, environmentally or culturally fair, and appropriate in format for 

O . 40 -^--^ \ 



the examinee. These tests would then be admins tered in a setting appropriate 
' tfi the examinee. 

Given the difficulty for the individual* teacher of developing tests with 
these characteristics, Spring Branch decided to mount a district centered 
curriculum/iest development effort^ As part of this effort, teachers and 
other s^Jf worked together to develop an instructional prograin and the tests 
for assessing student achievement in the program. The relationship between 
testing and instruction, and the associated test development effort, were 
guided by teachers' answer to questions of: 

. what skills or concep^do I teach this group of students? 

. what levels do I' use in instructing this gir'oup? 

. how do I teach for more than one or two levels at a time? 

. how do I provide instructional continuity for these students? 

The concern for providing a link between testing and instruction is also 
seen at the school level. Her£, representatives of the district office, the 
school principal, and teachers work together to develop a school instructional 
program, tied to district objectives, that will provide instructional con- 
tinuity for the indi vidua"' student across content areas. Students with dif- 
fereing skills, needs, and abilities can work together in the same program 
as long as the program is built upon a continuous progress philosophy and 
the skills of the highest priority for learning or foundation have been iden- 
tified. 

The task force develops test items and guidelines for test administra- 
tion to accommodate most, 1f not all» learning styles. Further, variations 
of the test design are made to facilitate the test matching the subject 
area being tested. In this regard, Barnett et al discuss the following 



considerations at the school level: 

• the design uses a composite type of criterion-referenced test so as to 
^-5^now students to exhibit both strengths and weaknesses In a given 
part of the program as well as to demonstrate overall proficiency. 
. the composite may also be designed to periodically retest some or 
all essential skills at a higher developmental level. This Increases 
the liklihood that reinforcement of Instruction will continue to be 
stressed in the classroom. 
, the design may also attach different values to. particular strands 

in the content area. 
. the design also includes a checklist which allows for teacher ob- 
servation of skills that are difficult to assess with paper-and- 
pencil tests. 

. the test allows for the quick assessment of the student's ability 

In the particular content area. 
At the classroom level, where individualized instruction and contin- 
uous progress methods are used, assessment provides the data upon which the 
teacher plans and operates a child's learning program. In the classroom, 
/ both norm- and criterion-referenced tests may be used. For example, a teacher 
may begin the school year by administering a norm-referenced test to deter- 
mine how the class as a whole or how an individual learner compares in per- 
formance wfth the aN^erage performance of the norming p6pulation. To generate 
the information needed to focus instruction of individual needs, criterion- 
referenced tests are administered to Identify the student's status In rela- 
tion to established performance standards. In this regard, the teacher has 
available criterion-referenced tests that are used for Initial placement in 
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the program and a series of criterion-referenced tests to monitor each stu- 
dnet's progress as he or she completes a discrete Instruction unit. These 
tests are updated yearly for tec finical quality and content coverage. 

In conclusion. Barnett et al offer the following advantages of this 
kind or instructional/assessment program: 

. it helps teachers group children with common needs and to plan 

f 

instruction based on the needs and learning styles of those in 
the group. 

. it enables teachers to monitor^the continuous learning progress 
of each student. 

. it assures that teachers will test what is taught in the class- 
room. 

. it allows clear communication among teachers, parents, and stu- 
dents regarding attainment of specific skills. 
. it assures integrated instructional programming. 
5. James Gallagher 

James Gallagher is Director of the Frank Porter Craham Child Development 
Center in Chapel Hill, North Carolina. In his presentation, Gallagher dis- 
cussed problems and procedures associated with minimum competency testing pro- 
grams. He addressed some of the reasons behind the demand for such testing 
progracns, the scholarly reaction to this demand, and the response of one state 
to develop a minimal competency testing program- 
Gallagher first described the growing public demand forj minimal education. 
In large part, this demand has been in response to disconcerting reports about 
the current status of public education — the drop in acf^ievement test scores; 
decline in student knowledge of the 'sciences; large numbers of the adult 
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population being found to be Illiterate; students with limited writing pro- 
ficiency; average scores of students applying for college being at the ninth 
grade level, and so forth. 

Public response has been to demand some form of minimal education; pol- 
icy makers have translated this demand into the establishment of minimum 
standards in the schools. Minimal competency levels, Gallagher argues, can 
only be established through the use of informed huipan judg,ement. But the 
critics would say that using human judgement to set standards in "arbitrary*' 
or "capricious,*' Gallagher, however, asserts that such judgements cnn be 
based on the* evaluative capabilitie^s of human beings to make reasonable 
decisions that standards can be based on reasonable knowledge and sensible 
judgements. To be sure, there are gains and losses associated with the 
competency test issue. Students may be' misclaSsified, for example. On the 
other hand, competency testing can identify and help students achieve minimum 
academic skills. Supporters of minimum competency testing argue that the 
losses incurred in giving the test can be minimized with increasing sophisti- 
Ct^flon and program development, but that the losses involved In not providing 
such a program are substantial. 

According to Gallagher, most of the scholarly reaction to the call for 
minimum competency standards has been negative: meaningful standards cannot 
be set; even in such basic areas as, reading and arithmetic it is difficult 
to make accurate measurements; the assumption that standards must remain mini-- 
■»al ; that such testing is Intended to fail students. These problems not- 
»flthstanding, educators must attempt to make thejr standard-»«tt1ng activities 
more public and more systematic. 

North Carolina responded to the challenge by passing legislation to 
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assure that high school graduates possess skills and knowledge necessary to 
function%s members of society; to provide a means of identifying strengths 
and weaknesses in the education process; and to establish means for making the 
educational system accountable to the public for results. Gallagher enumer- 
ated the following points reflecting the legislative intent: 

. all nth graders were expected to take tests satisfying minimum 
competency requirements for graduation. 

. a trial testing of all 11th graders was first to be conducted. 

. full scale testing of all 11th graders would then begin. 

. students failing any of the tests could retake the parts of the 
tests they had failed. 

. local schools were required to provide remediation assistance 
^ ' to students demonstrating less then minimum competence. 

. a Competency Test Commission was established to aid in carrying 
out the intentions of the legislation. 

Any statewide minimum competency testing program must answer the following 
questions: what competencies should be addressed? what specific objectives 
will this involve and how are they to be measured? what constitutes minimum 
competence and what is to be done with students who do not pass? In North 
Carolina, the following procedures were enacted with these questions in mind. 

The trial testing phase was to be limited to reading and mathematics. 
Groups of reading and math teachers rated and recommended potential instru- 
ments for the trial testing. All LEA's in the state were sent a list of over 
250 minimum competence mathematic and reading objectives and were »sked to 
prioritize them. The teachers who had reviewed the measures were then asked 
to. cluster and compare the objectives rated by the LEAs in each of the field 
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trial instruments. These clus^.ers were used to determine how well the recom- 
mended tests would measure the curriculum objectives deemed roost desirable. 
Stud^tg. failing to meet minimum competence standards as measured by the tests, 
but who meet other graduation requirements, would be provided with a certifi- 
cate instead of a diploma. The LEA must provide a basic skills remedial pro- 
gram for those who do not pass. 

The specific procedures of the>. North Carolina system were as follows. 
Some 15 commercially available measures were reviewed in reading and'mathema- 
tics. Three tests for reading and thrae for mathematics were selected on the 
basis of emphasis on functional application of basic skills; emphasis on mini- 
mum competency; congruence wit)i the schools' educational objectives; publisher 
commitment to further test development; attention to the elimination of cul- 
tural bias; provision of adequate technical information; and ease of test ad- 
ministration. Analyses of the spring ty-out of theS^measures (with 36,000 
students involved in the reading tr/-out and 36,000 in the mathematics try-out) 
resulted in the^selection of the /SHARP (reading) aniil the TOPICS (mathematics) 
for use in the fall of 1978, { 

The commission wanted to eirsi/re that the tests be as free of cultural 
bias as possible. Analyses of student perfomance on individual test items 
showed that some items did exhibit bias: the total number of items modified 
or removed for all reasons (to match state education objectives or to reduce 
cultural bias) exceeded 40% in reading and 50% in mathematics. 

The final task was to set minimum standards or cut-off scores on SHARP 
and TOPICS. To help establish these standards, four studies were conducted: 
(1) to compare competency test and norm-referenced test results; (2) to 
determine teacher judgement of minimally competent students; (3) to determine 
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teacher judgement on cut-off scores; and (4) to examine the Items omitted by 
students taking the test. When the results of these four studies and the total 
spring trial analyses were available and correlated, preliminary cut-off 
scores were established. These cut-off scores were then reviewed and finally 
set at 72% correct on the reading test and 64% correct on the mathematics . 
test. 



These summaries represent the kinds of issues presented during the first 
morning of a Regional Conference. As previously stated, the presentations were 
discussed before moving into the afternoon test development activities. This 
discussion dealt with each speaker's key concerns, and provided a bridge to the 
ensuing sessions on the CSE materials. 

CSE activities associated with summarizing these presentations was com- 
pleted by September of 1979. The extension of the original contract to de- 
velop a book of reading on testing and instruction compiled from the confer- 
ence speeches took place between April 1 and August 31, 1980. During this 
period of extension, and after extensive editing and materials writing by 
Test Conferences staff, the formal papers were sent to authors for review 
ar}d approval. The, final volume, consisting of all formal papers and intro- 
ductory and concluding materials written by CSE staff, is separately bound 
in Appendix C. This volume ils entitled. The Role of Testing in American 
Schools , James Burry and Eva L. Baker, Editors. CSE Is currently exploring 
commercial avenues for publishing this volume. 
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DESCRIPTION OF CSE MATERIALS 

For each Regional Conf/rence on Testing and Instruction, a notebook of 
CSE materials was providera for each participant. These materials were used ^ 
In the aftern^n of the first day of each conference. The primary purpose 
of these materials was to offer a practical guide for teachers, curriculum 
and test developers, and school administrators involved with testing and in- 
struction. Taken together, the materials attempt. to improve both testing 
and instruction by integrating them both at thfe basi^c level: the classroom. 
By focusing on those aspects of instruction crucial to testing and the ele- 
ments of testing which critically affect instruction, the materials serve 
as a handbook for those who teach, who prepare curricula, and who select 
and administer tests. They provide instruction and examples on: 

a) domain-referenced tests 

b) item-rating scales * • 

c) test selection: comparing test relevance to a given 
curricul um 

d) test selection: comparing the technical and practical 
merits of tests 



The Afternoon Session Materials 

The materials used in the afternoons of the first day sessions 'were 
designed to take information developed in the field of testing and provide 
both context and exercises through which the participants would develop 
some familiarity with the concepts and procedures discussed. In planning 
the afternoon session, a number of options were originally considered about 
the strength of "treatment" of the materials and the likelihood that a rela- 
tively short session /(ranging from 2-4 hours) could actually develop partici- 
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pants* skills. It was clea/* from previous instructional development exper- 
ience that the time available at the sessions should not be spent in the 
individual perusal of materials.. A conference derives its benefit In parjt 
from the interaction of individuals. It has alsQ been CSE experience that - 
asking individuals to "read up" in advance of a workshop or conference often 
results in a range of responses; some participants 'do and others do not and 
the spread in skills is accentuated by this uneven compliance. A further con- 
sideration was the topic itself, testing and instruction. We felt that such 
issues were best treated in the context of personal interaction. Thus, the 
materials were structured so that conferees would be "talked through" the 
concepts included, participate in a group problem solving exercise or two, 
and then leave the conference with materials in their possession and^be able 
to use them independently to pursue their professional interests. 

The substance of the materials, dealing with domain-referenced testing, 
item review procedures, and test selection derived directly from other NIE 
funded work at CSE. Thus, the task of materials development could be accom- 
plished because the conceptual basis of the product had already been created. 

The four modules used were designed to .give practical suggestions on 

♦ 

how to connect testing with instruction for the mutual benefit and improve- 
ment of each. Each of the four topics has a functional definition guideline 
for its use, as well as examples showing how the procedure can be used in a 
school setting. 

The first topic, domain-referenced testing^ explains a domain-referenced 
test and the terms associated with it, provides instructions In writing 
domain-referenced test specifications, and includes sample domain specif i- 
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cations. Domain-referenced test specifications provide a two-way chart con- 
necting learning outcomes- to Instructional content and the assessment of 
learning. These charts are developed with, sufficient clarity so that some- 
one reading them will understand what instruction is implied and then be 
able to develop appropriate test items from it. For example, domain speci- 
fications define the content of subject matter area and the skills or be- 
haviors within that area which the teacher will teach and which the studept 
is expected to learn. Description of instruction includes the materials to 
be used, the times spent on various materials, the kinds of activities and 
practice the student will be doing throughout the course, and perhaps an 
explanation of what the teacher will do. The test specification identifies 
more precisely those specific content areas to be emphasized during instruc- 
tion/and which will be the basis for the test at the end of the instruction. 
Test questions on the given subject are written to provide a valid sampling 
of student learning under the conditions described in the domain specifica- 
tions. Thus, each- step in domain specification defines the preceding one in 
more detail, making it more concrete. Because they are built around specific 
instructional content and objectives, tests developed in this manner may pro- 
vide a more sensitive assessment of what the learner has learned, and can lead 
to prescription responding to the test diagnosis. 

" The second topic, the ite))o review procedure, is intended for use after 
a domain-referenced test has been developed or to assess test items developed 
by others. The scale is concerned with descriptive validity and the extent 
to which a given test item reflects the content of the domain; how well the 
item reflects the domain will affect the degree to which test performance 



Is an accurate -Indicator of student performance in the domain. An item- 
rating scale provides a methodology for judging the degree to which a test 
i^tem belongs to the hypotheticaT set of Items described in the domain test 
specifications. This kind of judgement, involves examination of the rules 
governing membership in the set to determine the degree to which the item 
, is a representative sample of the set as defined by th^ membership rules 
(see Polin tt Baker, 1979). The scheme allows for an item- by- ite;rfjre view of 
a test or an item pool, and a numerical rating of the item in^e'rms of each 
feature of the domain test specifications. Th8»final rating indicates how 
well the individual test item represents the domain as described in the 
specifications. This scale provides a tool for test makers to evaluate a 
test on the ba'^is, then, of how well the test items actually represent the 
content of instruction stated in the domain specifications. More specifi- 
cally, the scale provides a means of judging a test item from the standpoint 
of such features as: how well the item meets the general description of the 
domain; how well the item compares to the limits of acceptable instructional 
content; how, well the item meets the rules established for item generation, 
both from the standpoint of selected and constructed responses; and how well 
the Item matches the features specified for test format, test directions, 
and sample test item. In addition, the scale offers guidelines for judging 
item appropriateness for the intended students from the standpoints of lin- 
guistic and cognitive complexity. Explanatory terms. Instructions, and 
sample test items (as well as their respective domain test specifications) 
In secondary English punctuation, elementary mathematics, and elementary 
science are included in the materials used with the Item-rating scale pro- 
cedure. 
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Topics three and four In the CSE materials are concerned with test se- 
lection. The third of these topics deals with comparing tests' relevance 

__i^ith -a-gi^en-cw^^CAJl^ — It provides step-byTst^p details for :CCMnp^riag__ 
test items with specific curriculum skills In order to choose the most appro- 
priate test for use on a schoo\-wide, multi-level basis. It thus Involves 
a series of judgements about (one's own) curriculum objectives and the degree 
to which these objectives are reflected In a candidate test, expressing these 
judgements numerically, combining the results for a single test, and compar- 
ing the results across tests. That is, the comparative procedure, defined 
in terms of curriculum and skill objecjtives, offers another, method for de- 
termining the match between what is actually taught (the content of the domain 
specification, i.e., the curriculum objective) and what the (selected) test 
measures. The greater the congruence between the test and the curriculum, 
the greater the likelihood that students' test scores will reflect what they 
have learned. The procedure is particularly applicable for deciding on major 
tests, such as school-wide achievement tests. For example, it permits test 
selection to be jointly shared by teachers, curriculum developers, testing 
specialists, and administrators; It helps the user to find the test most re- 
sponsive to local needs; the procedures, while explicit, may be adapted to 
meet local constraints; finally, the procedures focus on such Important de- 
cision areas as the proportion of a test battery that is locally relevant, 
the proportion of the local curriculum that a test battery covers, the im- 
portance of the skills covered, and the appropriateness of the test's diffi- 

. culty for the intended students. The materials used in this topic also in- 
clude a sample test relevance rating form and instructions and explanatory 
notes. p 
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The fourth topic deals With the test selection decision In terms of 
• the comparative technical and practical merits of tests. The procedure 
detailed in this topic describes the specific features to be used In rating 
these teetvnicaT and practical me^n Amopg these features are 

the objectives or the domain a test ^neasures , the adequacy of the test's devel 
ment process, the degree of and manner* in which the test was field validated, 
the appropriateness of the test for the Intended examinees, the procedures 
involved in administering the test, and how test scores are reported and 
what interpretations they permit. Instructions are given for rating tests 
on these kinds of features; more importantly, the materials address ways 
in which the potential listing of test features to be evaluated can be modi- 
fied to meet local needs in testing. That is, for each of the broad test 
features listed above that may be assessed for local relevance, the mater- 
ials discuss a variety of sub-topics that may or may not be important to 
the local user. 

The difference between procedures used in the first two modules and 
those in the second two modules can be thought of in terms of the control 
of the person charged with test development or selection. Modules one and 
two assimie reasonable control over the test development process, perhaps 
in the careful preparation of teacher made tests, or a district development 
effort in testing. Procedures three and four are attempts to make the test 
selection process specific, but principally for those situations where the 
test is prepared by others, e.g., cormiercial firms or consul tknts. 

In addition to the materials described above, a glossary of terms is 
Included, as well as a list of organizations where testSt test Items, cur- 
riculum objectives, and domain-referenced test specifications may be ob- 
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talned. The materials are accompanied by a facilitator guide to be used 
for small group training sessions. 

, All these materials went through several revisions* based on field-test 

results, prior to their use in the test conferences* On two different oc- 

III.. — 

casions each section was field tested with groups of elementary teachers in 
a southern California school district, and revised between each" field test. 
The third field test preceding the^ revision prior to the first conference 
was admtnistfered to secondary tea'chers in kn Arizona school district. (This 
district's research and evaluation staff /ha^s recently developed specifica^ 
tions 1jor doraa in-referenced testing on j/di strict-wide basis for both forma- 
tive and surmative evaluation purposes.) 

Data and informal feedback obtained during earlier conference presenta- 
tions led to further revisions of the materials during Spring, 1979. On the 
basis of all try-out data to this point, revisions consisted of the following 

a) the facilitator's guide was modified in format to provide 
greater ease of use; the content of the guide was amplified 
to provide greater background that the facilitator could rely 
upon to inform his/her presentation; examples were added to 
provide a greater link with the kinds of topics discussed by^ 
the major speakers on testing and ins'^tr^uction in the momin^'^ 
sessions. 




b) overhead transparencies were developed foT\usj£-4R--*he^ection 
dealing with domain-referenced testing and the item-rating 

- scale 

c) the item-review scale worksheet was simplified 

d) sample domain specifications used throughout were reduced in 
number and made to focus on basic skills 

e) materials throughout were modified to provide a tighter simu- 
lation in which to use the materials for training 

Given tiie constraints of time, local (non-CSE) staff who used theinater 

ials described above to facilitate small-group orientation to issues in test 
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•'developn«ntand selection prl^Hly reVled^n self-tr.lning In the use of the 
naterUls at the Regional Conferences. 

The CSE training ^terials «re further reviewed and revised during the 
latter contract period in order to Improve the package. 

As mentioned previously, the materials were subject to Independent ex- . 
ternal and internal reviews. On the basis of these reviews, the materials 
have once again been revised. These reviews helped assure the usefulness of 
.the materials to teachers and others involved in test development or test se- 
lection; application of the materials in the development of a variety of as- 
sessment techniques; the elimination of excessive jargon; expansion of the 
range of examples provided; and appropriateness of the leader's guide. 

The materials have also been useful in CSE research activities, parti- 
cularly in the area of domain-referenced test development and review. The 
existence of the materials has allowed a training condition after which 
estimates of the utility of the Item-review schen« can be made. The materials 
were also successfully applied in a bilingual program setting in which the 
concern was with the develop^nt of a test of English as a Second Language. 
They have direct application In the field of writing assessment, and have 
great promise for further research on refining categories of the rating scale, 
particularly those of cultural and linguistic dimensions. 

CSE is now considering appropriate means of publication and dissemina- 
tion. For example, it ™y be that . "print version" could be published as 
part of the volu« on testing and Instruction; 1t may be that . "hands-on. 
workshop" for^t could also be ™.e available to those p«pl. .«k1ng ^--t 
technical assistance in the area of test selection and development. 

The revised testing materials. MaHnq. choosinji and using tests: A 
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practicutn In domain-referenced testing , Eva L. Baker, Linda PoUn, and James 
rry. and the accompanying leader's guide, are separately bound as Appendix 
D of. this report. 



ERIC 



56 



4. 



- CONFERENCE RECOMMENDATIONS 

During the second day of each of the Regional Conferences, one of the 
major activities was to elicit from the paticipants their recommendations 
about regional issues, needs, and problems in testing. Another concern was 
to get a sense of the conferees' perceptions of the value of the conference 
as a whole, as well as/of the CSE materials. While this section of the re- 
port is primarily concerned with recoriiDendations, we will first briefly pre- 
sent some broad trends reflectingjcoo^e'rees * valuing of their experience. 
(Summaries of across-conference and regional evaluations are in Appendix E.) 

In terms of the entire conference, participants were^ generally enthusi- 
as tic about speakers, small group sessions, and the opportunity to exchange 
ideas with colleagues. There was an obvious feeling that the Regional Con- 
ferences on Testing and Instruction provided a necessary first step in de- 
veloping dialogue leading to improvements in testing practice. Some parti- 
cipants would have preferred a greater nurnber of ^eacheps to be in atten- 
dance, supported by funds for released time. 

In terms of CSE testing materials, participant respdnse was quite 
positive in ternfs of pqtential usefulness of the materials. The most 
common theme was that, should similar conferences be conducted, much more 
time must be devoted to training. The materials were full of new ideas 
that required time for digestion. A second prevalent theme was the*need 
to use simpler language in the narrative accompanying the practice activi- 
ties. Such revisions have been accomplished. 
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Data Collection 

Procedures for collecting reccomnendations from participants on problems 
•nd 'needs in testing varied across sites and depended upon the sub-contractor's 
organizational preferences. For the first of the regional testing confer- 
ences, {Region V, Detroit, it had been expected that a panel convened to pro- 
vide a sense of the conference would also attempt to guide participants 
through the process of making their recommendations. Primarily because of 
time constraints, this method 'of drawing recommendations did not prove to 
be feasible. Consequently, before the second conference took place, Region 
X, Vancouver, Washington, discussions with the staff of the Northwest Re- 
gional Educational Laboratory led to the development of a specific form and 
technique to draw recommendations from the participants on a set of topics 
important to testing and instruction. 

During the second day of the Vancouver conference, participants worked 

in the same small groups in which they had been oriented to the CSE testing 

materials during the first day. Guided by the same facilitators who had 

worked with them previously, participants in small groups wefe assigned one 

of the following topics and asked to make recommendations in terms of the 

sub-questions in each major area of concern: 

TOPIC I: DATA USEFULNESS 

Question 1: What test score data have you found useful and for what 
purpose? 

Question 2: What do you consider to be inappropriate uses of tests? 
To what extent are tests used inappropriately? 

Question 3: What can be done to make test data- more useful for re- 
porting to parents and the public? What test data should 
be reported to the public? 

i 
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TOPIC II: TEST SELECTION 



Question 1: 



Who should be involved in the selection of existing 
tests used at a local level? What kind of test selection 
process should be used? 



Question 2: What kinds of tests do you need that are not readily 
available? 

TOPIC III: INTEGRATION OF TESTING^-WITH ADMINISTRATION AND PROGRAM EVALUATION 



Question 2: What misuses of tests are most conmon at the program 
administration level? 

Question 3: What testing or assessment techniques, other than standard- 
ized achievement tests, would you like to see used "for 
program evaluation and administration? 

Question 4: What factors should be considered in developing or 
implementing a testing program? 

TOPIC IV: INTEGRATION OF TESTING WITH INSTRUCTION 

Question 1: What kinds of tests and scores are most useful to teachers? 

Question 2: What can be done to increase usefulness of testing to 
instructional staff? 

Question 3: What are the appropriate and inappropriate uses of 
teacher-made te^sts within the classroom? 

TOPIC V: TRAINING AND RESOURCES 

Question 1: What preservice training is needed (for and by whom) to 
promote appropriate and beneficial test uses? 

Question 2: What inservice training is needed to promote worthwhile 
test use? 

Question 3: What other human and material resources are needed and 
available to promote worthwhile test use? 

TOPIC VI: TEST DEVELOPMENT 

Question 1: What issues are paramount with regard to test develop- 
ment? 



Question 1 : 



What can be done to increase the usefulness of test 
results for program administrators? 
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TOPIC VII: CONTROL OF TESTING 

Question 1: How should testing be coordinated to ensure that it is 

efficient and that it provides the necessary Information? 

Question 2: In what ways should the federal government be involved in 
determining the kind and extent of student testing? 

Question 3: How could testing costs be reduced? 

At the conclusion of the small group sessions, facilitators collected 
the information and then summarized topical recommendations at a plenary- 
session. 

This method of obtaining regional recornDendations was successful. Both 
the data collection form with the proposed areas of investigation and the 
manner of obtaining recommenaations were then offered to the remaining 
test conference sites as a suggested model for obtaining recommendations 
from the participants. All of the remaining sites, with one exception, 
followed the topical approach used at Vancouver to elicit participant 
recommendations. 

At the Region IX conference in Los Angeles, test selection/development 
concerns were combined to form one topic, groups were given a topical 
assignment and again participants were guided by their small group 
facilitators: this was almost identical to the Vancouver form/approach. 

At the Region VI conference in Houston, a form similar to the one 
developed for the Vancouver conference was used. However, the manner of 
obtaining the information differed somewhat, and participants were asked 
to respond to ten specific questions, each of which had a counterpart 
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either in a broad topic from the Vancouver conference or a sub-question 

of the broad topic. The specific questions posed to the Houston 

participants were as follows: 

\) The three biggest problems associated with educational testvng^ 
in the public schools are: 

2) What kind of preservice training is needed (for and by whom) to 
promote appropriate and beneficial uses of tests? 

3) What kind of inservice training is needed (for and by whom) to 
promote worthwhile test use? 

4) What do you consider to be inappropriate uses of tests? To 
what extent are tests most commonly misused? 

5) What test scores have you found most useful and for what purposes? 

6) What kinds of tests should be developed at a state or national 
level rather than using already existing standardized tests? 

* 

7) What kinds of tests should be developed at a local district 
rather than using already existing standardized tests? 

8) Who should be mainly involved, and in what ways, in the selection 
of already existing tests used at a local level? 

9) What kinds of tests do you need that are not readily available? 

10) Do you have any other concerns or issues that could help us to 
detect expectations and directions on testing in education? 

The manner of data collection was also somewhat different. At the Houston 

conference each participant was asked to respond to the above questions. 

The form was passed out to participants during the afternoon session of 

the first day. Participants were asked to have their forms completed before 

the close of the second day. In addition, each small group elected a 

local spokesperson who would report out the kinds of recommendations made by 

his/her group before the entire audience at the close of the second day. 
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The areas of possible reconmendation and the manner of collecting 
information differed somewhat at the Regions I and II conference In 
Boston, although the topical approach was still followed. At this 
conference, participants were asked to complete an opinion form. This 
opinion form ar.ked the following open-ended questions: 

1) What do you consider to >be the- three biggest problems associated 
with educational testing? 

2) How should the federal government be involved in testing issues 
(e.g., research, conferences, material development)? 

3) How can state departments of education tie helpful to school 
districts on testing issues (e.g., technical assistance, research, 
information exchange)? 

4) How should testing be coordinated across the state, district, and 
schools to make testing efficient as well as useful? 

5) What kinds of tests should be developed at a state or national ^ 
level to replace or supplement existing standardized tests? 

6) Are there any other comnents about educational testing you want 
to bring to NIE's or the Network's attention? 

The method employed at the Region. IV conference in Atlanta was similar 

to the method followed at Boston. Before leaving the conference. Atlanta 

participants responded to statements about testing and provided their 

opinions on a scale ranging from strongly disagree to strongly agree. ^ 

These questions were as follows: 

1) State departments should provide more technical assistance on 
testing to local districts 

2) * The federal government should provide more technical assistance 

on testing to local school districts 

3) Teacher training institutes should require all candidates for 
new or upgraded teaching certificates to take at least one 
course on testing 
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4) One of the biggest obstacles to -Implementing objectives based 
testing programs is the difficulty in keeping adequate student 
fecords 

r 

5) I would like to have -alternative ways to objectively assess 
student competencies besides standard paper 4ind pencil tests 

6) Teacher made tests can eliminate the need to purchase commercial 
test instruments 

7) An expenditure of up to $10 per student per year would be a 
worthwhile investment in a well-de^signed district testing program. 

In addition, participants at this conference were asked to list what they 

feel to be the three biggest problems associated with educational testing 

in the public schools, and to write in any additional comments about 

testing that tHey would like to bring to the attention of NIE or the local 

sponsor. 

Recommendations from the participants at the Regions VII and VIII 
conference in Kansas City were elicited in an entirely different manner 
Before leaving this conference, participants were asked to spend some time 
after the conference reflecting on their experience, and then to mail to 
the local sponsor recommendations for follow-up in terms of their 
appropriateness to the local level, the, state level, and the national level 

No reconmendations were drawn from the participants at the Regiorf III 
conference in Haverford. 

Thus, there were three basic means of eliciting recommendJitions from 
conference participants: 

1) Use of the form developed for the Vancouver conference; the 
questions remained the same or quite similar; manner of gathering 
and recording remained almost identical; recorder nay have^ changed 

2) Locally 'generated topical opinionaire 

3) Mailed responses 
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However, the recommendations across conferences produced a great deal 
•of agreement, suggesting that the recommendations received were not 
necessarily a function of the kind of measure used. 

Recommendations Across Conference Sites 

What follows is a recounting of participants' views as they are 
represented across all Regior^al Conferences. It is difficult to differen- 
tiate the strength with which various recomnendations were made, partly 
because some conference recommendations were made by a single group and 
snythesized by a leader-reporter (following a procedure used at the 
National Conference on Achievement Testing in March, 1978), partly because 
some conference recommendations were made by more than one group, and 
partly because recommendations at some conferences were gathered from 
the individual participants. 

With these caveats in mind, the following trends seem to emerge 
across all conference sites. They reflect opinions of the approximately 
1 ,200 people who participated in the conferences. ('Summaries of 
recommendations by Regional Conference are included in Appendix F; a 
listing of participants, by conference, appears in Appendix G.) 

Test Purposes/Uses : Usefulness of test data was considered one of the 
most important issues. Participant comments '^indicate that test results, to be 
useful, must be related to what is taught, and must provide the basis for 
follow-up instruction. Test results providing placement and diagnostic 
Information are most helpful, as are tests showing competency data from 
the beginning of instruction and rates of growth at specified times 




throughout the learning period. Even the most useful test results can 
become inappropriate through misinterpretation in explaining the results 
to students-, parents, or the general public. Misunderstanding of test 
results can best be prevented by providing appropriate information and 
training for those responsible for administering tests, using test results, 
and disseminating information on test results. Information and training 
are not sufficient, however. Other essential requirements include: 
establishing a basis of trust and involvement among all those involved in 
the testing process, developing alternatives to standardized testing, and 
using multiple measures, not one single test score, in making decisions 
about a student's placement and curriculum. Many participants stressed 
concern about the standardization of tests in general, questioning their 
validity for meeting the local needs of their students, and asking for 
•other evaluative and assessment procedures, instead of paper and pencil 
tests, to gauge learning. 

Participants believed the existing test oriented models have measured 
test results for their own sake, to the exclusion of learning results, and 
that this focus has created a sense of failure in students, A shift in 
perspective is necessary, one that utilizes a curriculum-oriented model to 
emphasize what has been learned. What participants have asked for amounts 
to a change in the purposes and values of testing, so that tests become 
the commencing point for the student's educational progress. 

Testing Constituency : Regarding local test selection, participant^ 
believed that representatives of all groups — administrators, teachers, 
test specialists, counselors, parents, and curriculum developers — 
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should be involved in the process of deciding which tests to use. This 
process should involve three steps: 

1) Deciding on the purposes of the test. 

2) Representing all schools taking the test on the test 
selection committee. 

3) Having all tests reviewed by a panel of teachers, parents, 
curriculum specialists, and testing specialists to insure 
appropriate content, technical adequacy, and practicality 
for administration. 

Test Application : Integrating testing with program evaluation and 

administration can be achieved more successfully if teachers, parents and 

administrators are more fully informed about the purposes, content, and 

results of tests, and if all those involved have an opportunity to review 

the results before any action is taken. Misuses, of tests can be avoided 

at the program level, if all those involved had more information and 

training on selecting tests, and on using test results appropriately. FoV 

program evaluation and administration, assessment techniques other than 

standardized achievement tests are worthwhile. Such techniques as 

informa.1 staff, community, or student surveys, measures of affective and 

psychomotor skills, teacher-student ratios, attendance, drop-out rates, 

and longitudinal follow-up studies to track student performance over a 

period of years, can all provide valuable results that can support or 

challenge other data, and should not be overlooked. In developing a testing 

program, the purpose of Resting must be thoroughly set forth from the 

beginning; all those affected by the testing should be involved in test 

planning if the program is to provide useful data for administration, 

evaluation, and instruction. This demands a well -coordinated group effort. 



Integrating testing with instruction can be accomplished best by 
formal and informal teacher diagnb^s of students, involving the entire 
staff in every step of the testing tk^ocesTTNand using classroom tests 
•ppropriately (i.e., to create maximum instructional flexibility and 
Immediate feedback). 

Coordination of Effort : Regarding training and resources, participants 
asked that a course in the practical aspects of testing be part of teacher 
preparation for certification. Continued inservice training is also needed, 
and specialized training for those who report to the public- 

The participants s^^ggested also that parents be involved as members 
of advisory /doninittees\ and that district personnel be helped to develop 
a positive attitude toward testing. 

The participants agreed that teachers, parents, and administrators 
need to become more involved in test development, but they also acknowledged 
this goal puts additional demands and pressure on an already burdened staff. 
While technical assistance or outside test developers are helpful, a 
review by local staff and community personnel is necessary. 

Participants indicated that the control of testing, and the coordination 
of federal, state and local testing programs, should be clarified.- Most 
participants believed the federal government should sponsor and fund 
continued research in all the issues in testing, as well as disseminate 
guidelines in clear language on compliance issues and questions of equity; 
the federal government should not be involved in measuring student 
achievement- The participants stated the absolute need for clear state 
guidelines on the responsibilities of school districts, and each district 
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should be responsible for determining what test Information Is required, 

the measures that are acceptable, and how to obtain these meas.ures. 

Across all Regional Conferences, then, reconmendations appear to 

reflect four areas where change is needed: 

testing perspective - there is a need to refocus the purposes 
and uses of tests 

decision-making constituency - a much more broadly-based 
constituency should be involved in decisions about test selection/ 
development and use 

instructional application - test development/selection should 
reflect 'matters of timeliness, format, information provided, to 
allow testing to be integrated with instruction as needed by teachers 

coordination of efforts - greater coordination is needed among 
federal, state, and local testing needs; training, technical 
assistance, and dissemination will be part of this effort 

Recommendations by Conference Site 

The following recommendations, in highly abbreviated form, were made 
at the individual conferences. Many of these recommendations are 
represented in the preceding across-conference summary. , 

Region X: Vancouver Conference . Approximately 180 people participated 
in this conference. Participants at the conference included teachers, 
evaluators and planners, measurement specialists, administrators, counselors, 
and university personnel. 

. . Data Usefulness : 

use alternatives other than "average" scores 
need forldi agnostic/placement/competency data 
improve means of' reporting test results 
need for prompt feedback on test results 
need for interpretation 
use of multiple measures 
use of alternatives to traditional measures 
educate broad constituency in tests and testing 
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Test Selection/Development : 

involve broad and representative constituency 
-develop alternative measures 



Integration of Testing With Program Evaluation and Administration : 



need to train program administrators In test selection, 

administration, and interpretation of tests 
use one test for several decision purposes 
prepare. and involve staff and non-staff in testing decisions 
gather information from sources other than tests 

. • Integrating Testing with Instruction : 

involve teachers in all steps of the testing program 

use test results for changes in the instructional program 

rely more on teacher-made tests 

. . Training and Resources : 

provide preservice training in test construction/test use, and 

incorporating test results into instruction 
provide inservice training to teachers and administrators in 

presenting, using, and interpreting test results 
involve parents and community groups in review/advisory capacity 

. . Control of Testing : 

need for clear state guidelines on district' responsibilities 
need for clear federal guidelines regarding 'compliance/equity 
leave control at loc?! district 



Regions VII and VIII: Kansas Cit^ Conference . Approximately 100 people 



participated in this conference. While\othen target groups appear to have 

been well represented, teacher participation was low. 

- . Reconmendations to LEAs: ^ 

provide inservice training in test selection/development and use 
examine use of alternative measures 

. * Recommendations to SEAs : 

provide resources to districts interested in exploring alternative 

testing approaches 
avoid statewide testing programs 

provide training in broad scope of evaluation techniques 
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. . Recommendations to the "Federal level : 

: i 

encourage districts to explore alternative testing approaches 
provide technical/financial assistance 
promote dissemination of good testing practice 

Region IX: Los Angeles Conference ^ Approximatel|r 100 people attended 
this conference. Instructional, administrative, and governmental staff 
appeared to be quite well represented, 

• . Data Usefulness : 

use of multiple measures 

increase student understanding of testing 

need simplicity in information 

need diagnostic information 

use scores for motivation and feedback 

Test Development/Selection : 

need ""or locally developed measures 
need for federal/state/local cooperation 
need to compare results of local measures with standardized 
measures 

_ Interpretation of Testing with Administration and Program Evaluation 

promote wi thin-school instead of between-school comparisons 
test sensitivity to local goals* should be the basis for test 
selection 

• • Integration of Testing with Instruction : 

need to develop good diagnostic measures 

need to arrange scores by skills and subskills 

increase teacher participation in test construction 

need for broad sharing of test results 

assure close correlation between test items and curriculum 

. . Training and Resources : 

workshops for teachers, administrators, parents on test use/hiisuse 

Regions I and 11: Boston Conference . Approximately 120 people 
participated in this conference. The target participant groups were quite 
well represented; responses were received from school personnel at every 
organizational and instructional level. 
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problem Areas : 

test misunderstanding/misinterpretation of results 

difficulty finding technically sound tests that are locally re'levant 

over-reliance on single test score 

_Role of the Federal Government : 

promote alternative test development 
organize conferences on test I'se/misuse 

. • Role of State Departments of Education : 

provide technical assistance v 
act as information exchange 
conduct research on testing 

Test Coordination : 

increase coordination across state, district, and individual schools 
disseminate information on successful testing programs 

• • Test Development : 

need for alternatives to standardized testing 
NIE leadership on promoting alternative approaches 

Other : 

NIE sponsored training programs and information exchanges 
Region VI: Houston Conference . This conference was attended by 

approximately 100 people. All targeted constituencies were in attendance; 

teachers were particularly well represented. 

. . Problem Areas : 

using a single test score for decisions about students 
using tests for purposes for which they were not intended 
overcoming student indifference to testing 

inability to interpret test results ^ 
poorly constructed teacher-made tests 

. . Pre-Inservice Training : 

all parents and all school personnel - especially teachers - should 
receive training in test purposes, test construction/selection, 
test interpfetation, and using results to 'Improve instruction 
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Most Useful Test Scores : 

diagnostic results 

grade equivalents and percentiles 

. . test Development Needs at State or National Level : 

minimum essentials on exit tests 

teacher competency tests (with input from teachers) 

tests which miniiriize cultural bia.s 

Test Development Needs at Local Level :- 

criterion-referenced tests reflecting local curriculum 

:>hort diagnostic tests 

bilingual tests 

tests of writing composition 

• . Selectio n of Tests at Local Level : 

broad and representative constituencies should be involved 

^Region IV: Atlanta Conference , Approximately 180 people attended this 

conference. Targeted participant groups were fairly well distributed. 

Need for sta^te department of -education technical assistance 

Need for technical assistance from the federal government 

Require all teacher candidates (or applicants for upgraded teaching 

credential) to take at least one course in testing 

t? 

Need for alternative assessment approaches 

Need to disseminate information on successful testing 
programs/techniques 

Avoid relying on single-score criterion for decisions about students 
Great need to inform the public about assessment programs. 
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IMPLICATIONS j 

Recommendations from the Regional Conferences, as previously stated, 

seem to fall into four broad areas of concern: 

the need for a new or amplified perspective of the purposes 
and uses of tests 

the need to involve a much more broadly-based constituency 
in matters of test selections development, and use 

the need for tests and testing to serve instructional 
applications and to embody characteristics that will 
facilitate their integration with instruction 

the need for greater coordination among federal, state, and 
local agencies 

The question arises as to how these needs, the many specific recommendations 
they relate to, and the range of issues discussed at the Regional Conferences 
might be addressed in the future. 

It seems clna^- that before these recommendations can become practice, 
there is a great m\'i to continue to provide training in the kinds of 
issues dealt with at the Regional Conferences* Further, to be effective, 
such training must reach the range of constituents suggested by the 
conference participants--- not only more teachtrs (as well as other 
educators) but also parents and boards of education. In addition, the 
conferences emphasized that the local curriculum should have primacy of 
position for building a useful testing system, that what is to be measured 
should reflect what is to be taught, and that the concept of what is 
effective measurement needs to expanded. 

Therefore, before considering application of new ideas In testing, 
further awareness-building and training experiences, slmilir to those of- 
fered at the Regioiial Conferences, might be considered. Some of the 
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concerns voiced by the participants could be addressed at the regional or 
state level, e.g., broadening the perspective of testing and txploring means 
of coordination of the various audiences involved. However, those recom- 
■endations reflecting need for instructional relevance of tests, how they 
are best selected or developed, and by whom, how they are best used, how 
their information is to be interpreted and integrated with classroom in- 
struction, might be more effectively addressed at the level of the local 
school district or, perhaps, the local school. 

To begin local efforts in such areas, the ideas raised at the Regional 
Conferences could be used by districts interested in responding to the is- 
sues raised. The problems discussed by speakers could be disseminated to 
such districts. The training offered might be exported. The information 
in this report could also be provided. With such information, local users 
could then consider the most effective means of providing training to their 
own staffs to meet their particular cohcerns in testing and instruction. 
This approach, further, might ameliorate the problems voiced about attempt- 
ing to provide training to an audience consisting of varying levels of skill 
and understanding of testing; attempting to provide training to an audience 
* with differing instructional philosophies, objectives and testing purposes; 
attempting to simulate test building and the validation of items against a 
hypothetical curriculum. 

Since further training might be needed before practice can change, and 
since the Regional Conferences s;eem to have been quite effective as a first 
step on this kind of training, ueans might be considered of providing similar 
activities at the level of the state, local school district, or school. At 
the level of the Individual school, 1t is more likely that commonali tief; of 
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Instructional and testing purposes will be found, thereby ftcmtatlng In- 
struction in test development and test use. 

Tentative findings from current CSE project activities in the matter 
of test use would seem to support the recommendation that the local school 
district and the school is an Ideal locus for the stimulation of test Infor- 
mation for instructional Improvement. Conference findings reflecting the 
need for an amplified perspective of the purposes and uses of tests, the need 
to involve a broader constituency in test selection, development, and use, 
the great need for tests to serve multiple decisions, including Instructional 
ones, and the need for greater coordination among state and local agencies, 
are supported by recent CSE findings on test use. 

CSE's Test Use project has found that school and classroom application 
of testing is a function of the design of the testing program and the per- 
ceived uses of the information. Issues of perspective and coordination 
raised at the Regional Conferences have a great bearing on the exemplary 
design of testing programs and the use of their results. In terms of de- 
sign, CSE has found that coherence of the school/district testing policy, 
its relationship with state testing policy, the kinds of leadership provided 
in the instructional uses of test information, and sense of '^ownership" of 
the testing program interact to influence the design of effective pr^pgfams. 
Teacher knowledge of tests and testing, teacher inservice in tests and 
testing, the uses of instructional alternatives In the schoqXflnd the per- 
ceived technical quality and instructional relevance of tests Interact to 
influence the Instructional uses of tests In schools. 

The CSE materials produced after the conferences the book of readings 
on testing and instruction and the associated materials on test selection 

ER?C " . , 



and development ~ would seem appropriate vehicles to stimulate a sense of 
testing perspective and coordination. Further, CSE's matcriaU address the 
full range of variables associated with test program design and test use. 
We hope that the materials will provide an Initial framework for the design 
of effective testing programs which yield information of use in the Improve- 
ment of classroom instruction. 
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List of Invited Speakers on Testing 
and Instruction by Conference 
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Conference 1 - Detroit, Michigan - Region V 

1 . Ron Edmonds 

Senior Assistant to the Chancellor of Instruction, 
Board of Education of the City of New York 

Topic: Testing 

2. Eva Baker 

Director, Center for the Study of Evaluation, 
University of California at Los Angeles 

Topic: Instruction 

Conference 2 - Portland, Oregon - Region X 

1. Eva Baker 

Director, Center for the Study of Evaluation, 
University of California at Los Angeles 

Topic: Appropriate Test Uses 

2. Madeline Hunter 

Principal, University Elementary School, 

UCLA 

Topic: Relating Testing to Instruction 

Conference 3 - Kansas City, Missouri - Region VII & VIII 

1 . Will iam Coffman 

Iowa Testing Programs, University of Iowa 

Topic:. Uses and Abuses of Tests, and the 

Relationship of Testing and Instruction 

2. Deborah Meier 

Principal, New York City 

Topic: Uses and Abuses of Test's, and the 

Relationship of Testing to Instruction 
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Conference 4 - Los Angel es> California - Region IX 

1. Madeline Hunter 

Principal, University Elementary School, UCLA 
Topic: Instructional Implications of Testing 

2. Peter Arasian 

Professor of Education, Boston College 

Topic: Uses and Abuses of Standardized Achievement Tests 

Conference 5 - Philadelphia, Pennsyl vania^ Region III 

1 . Ron Edmonds \ 

Senior Assistant to the Chancelloj of Instruction, 
Board of Education of the City of I New York 

Topic: Testing 

2. Madeline Hunter 

Principal University Elementary School, UCLA 

Topic: Instruction 

Conference 6 - Boston, Massachusetts - Region I & II 

1 . Peter Airasian 

Professor of Education, Boston College 

Topic: Uses and Misuses of Standardized Achieve- 
r ment Tests 

2. Eva Baker 

Director, Center for the Study of Evaluation, 
University of California at Los Angeles 

Topic: Relationship of Testing to Instruction 

3. Judah Schwartz 

MIT: Educational Deve.lopment Center 

Topic: >'^iect TORQUE: An Illustrative Example 
of How to Do It Differently 
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Conference 7 - Houston, Texas - Region VI 

1. William Angoff 

Executive Director for Technical Development, 
Educational Testing Service 

Topic: Historical Perspectives on Testing 

2. Jan Barnett, Vicky Hardway, Connie Myers 

Barnett is Assistant Director for Appraisal Services, 
Spring Brand ISO 

riardway is a 4th Grade Teacher, Spring Brand ISO 

Myers is an Elementary School Principal, Spring Branch ISO 

Topic: Criterion-Referenced Testing as an Educational 
Tool 

Conference 8 - Atlanta, Georgia - Region IV 

1 . Frank Womer 

Director, Michigan School Testing Service, 
Ann Arbor, Michigan 

Topic: Uses and Abuses of Tests and Testing 

2. James J. Gallagher 

Director, Frank Porter Graham Child Development Center, 
Chapel Hill, North Carolina 

Topic: Using Testing to Improve Instruction 
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Appendix B 



Regional Conference Agendas 





ctr •.-'•-9 XSm zOMtsfH^mi ■•firt'wpn,^^ 

5:30-9:30 Conlerencc Convmet ' • • ' • 
, . , Cft*l*V ^"**»" • ^-'-^^^ 



' Wiynt County Intermediate School 0i$UkXy^^/fi{ 



jnty 

Conference Purpose Juliette Noone Letter '^^^^^i^^^- 



USOE Rerional CommlMloner ' • 

i^^V.. • . . - -i. . .... :■■ ■■ ' -tegion VChlogo - , ; ^''^r-^ ... . 

' Senior A»sl«Unt to lIKi Chtncrilor l««mK«on ^, . . : 

i0:30-l0:45 ■ ■ :■ i^^'T-^'y;:. t-;;;'- . - 

10:45-11:45 Mrfnicffeo " 
Speaker Eva Baker 

Director, Center for the Study of Evaluation .^ 
'University of California at tos Angeles . . " ^ " 

12 noon umdt _ 

Speaker Hobert E. Taylor, Executive Director 

The National Center for Research in Mxrational Educabon ; 
The Ohio State Unh«rstty _ \„ _ir „^.-_^_C * 
1:30-5 p.m. Test Design and Relationship to Instruction : „ , . .Z ... _ 

RepUSntatiJes from the Center for the Study of Evaluation (CSE) in charge. 
Participants will divide into 9 training groups. 

Discussion/Report L4Baders /. - 

Croup 1, Room 532 lorenza Dtxoii Indiana 

Croup 2, Room 250A Doris Eldridge Missouri : , 

Croup 3, Room 250B Marian Kllbane-F4«sh Ohio - - 

Croup 4, Room 250C Tom Odneal MiMouri 

Croup 5, Room 223 John Osborne .,Michlgan 

Croup 6, Room 266 Walter Richardson Ohio 

Croup 7, Room 202 Joann Rochester Michigan 

Croup 8, Room 374 «oy Tally MinnesoU 

Croup 9, Room 156 Joyce Weddlngton iBennessee 

5if0O No-host Social Hour 
Blue Room 

Ramada Inn at Detroit MetropoliUn Airport 
8270 Wckham Road 

6:30 Dfnntr . . - 

Cold Room 



Ramada Inn at Detroit Metropolrtan Airport 
Presiding Wade M. Robinson, President, CEMREL, Inc. 

■ ..SClouis , ■ . - ■ ->•'- 
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oQi&ndo Wedriesdoy. 




Allen ZondUk, Director o( running, Detroit IPubHc Schools^ 
W. lames fopham, frofeasor of f ducatlon, Univeralty of Califonui.al lot 

Angeles ■ . ~ ■ ' , 

Stuart Ranlcin, Assistant Superintendent, lleseaict»,"ftonnlng •nd tfiNMrtlon, ' 
Detroit Public Schools • •• •• • l^-i^^kf^i:, ; ' • 

Pauline V. CHssom, DetioK Public Schools ^ ^ " \ . . : 

flaine.UndbeinvlnrtrMCtional Ob|ectlvef tKfhange/iw JM^iillw - 



■ mm-. 



^'10-1 1 :45 JNPOM* P«»»e/ 



lohn Dobbs, Assistant Superintendent /School and Commun 
gan Department of Education, Moderator . 

Ronald Boyd, Associate Superintendent, Indiana Department 
tion, Ti" .ekeeper . ; - v . - . , • • - 



r Affairs/ MichI* 
jbtic Instruc- 



Classroom Level 
School Level 
District Level 
State Level 
School Board 
Hegionat Office of 

Education 
Higher Education 



Fat Daly -Michigan 

Thenesa Denman Michigan 

Angeline Caruso Illinois 

David Donovan Michigan 

Frances Coe . lennessce 




Clark Chipman 
Harold Harty 



-lliinois 
Indiana 



National Dissemination Shirley Menendez Illinois 



12 noon lunch 

1:3(K3:15 



Speaker John W. Porter, Superintendent of Public Instructtori, 
Michigan Department of Education 



Select two different groups from chart: 



Group A 
RoomZSOA 



Group B 
Room 212 



ERIC 
Cteai 
Netwo 



Ctearincho 

TK 



use 



R&D Labs 
and 

Centers 



Croup C 
Room 2506 

Regional 

Dissemination 

Services 



Croup P 
Room223 

Special 
institutes 
and Centers 



ERIC Clearinghouse 
on Reading and 
Communication 
Skills ~ 
Urt>ana 

Bernard 0'EX>nnell 
DirecaiH 

i 4WC Oearlnghouse 
;t ' m Sdence, Math, 
. 'j&nd CfivffomnentaJ . . 
education 

Columbus . . . — ^ 
Robert W. Ho«¥e 
Director 

Region V, USOE 
Regional Office 
Chicago 

Oark Chipman ^ . 
1^ PI V ^ wiinatlon 

fcHJL 



CEMREL, Inc. 
St. Louis 

Harriet Doss WSIlis 
Director, Urt>an 
Education Program 

The Center for 
Uxational Education 
Columbus 
Robert 1ayk>r - 
fxecutlve Dlrwtor 



Midwest Regional 
exchange Protect 
St. Louis 
Dane Manis 
«Pro^ Director 



Center for the 
Study of Reading 
Urtv^a 

Brenda ). LerT>er 
Cbordirtator 



Research and • > * v Educattonal 
Development t ; finance and 

Interpretation. . \ x*>^.li^.!#*oductivtty 

^Service -^■i--s<u^^-~*^ji!i<**^^ ' -qz^-j^.? y-^"*-'-^ 

lk.'iouk \ ^ 

Hi Wuhington * C^ '^-^^'^fJOw^ BWw^ 



!MiconsinRJ.DCenief-^--- ;9fOi^ sStM :r:::^^ 
for Individualized • "fT^^^ ' ^ 

CHirw>Un0 teioufce and • . InsHtute for 



Schooling 
Madison 
Richard Rossmllier 
Co-Director 



tetoufceand 

Refer rd Service 
Columbus 
John Pileiion 
IVofect Director 



InsHtute for 
Research on 
liaching 
i. Lansing 

Ijiwrence Lezotte 
Coordinator 



1:! 

'11:20-2:25 ^'.twi£hi<fi yow i^^ 



•C^M^vi^^ Ceofge Crimes ^ . - , •. iiii-?^'?%5a»|KwS*r*^ • 

Sli; . • . Information Services, County . ^. 3, . . : ^^i^^S^ 4;. - , . , . . 

; liiteimtdlate Sctool Witrict Moderrtor >-:>^^^^^ C u^^.- 




State^wide Teacher Association — h-w 

Kentuclcy Education Association 
Martha Dell Sanders, Kentuclcy 

Central Office ^ 
Planning and Development |ohn Crate, Ohio ^ 

SUte Education Agency 

Planning and Evaluation Peggy Mauter, Ohio ■ 
Adjourn 



Midwest Conference on Testing and Instruction 

This conference is one of a series of eight planned by the Center for the Study of Evaluation University of 
California at Los Angeles/under a contract with the National Institute of Education. The Midwest Con- 
ference is coordinated by the School and Community Service Croup of CEMREL, Inc.; theSt. Louis-based 
educational laboratory, in cooperation with the Wayne County intermediate School District. States In the 
CEMREL region are Illinois, Indiana, Iowa, Kentucky, Michigan, Minnesota, Missouri, Ohio, Tiennessee 
and Wisconsin. 



Midwest Conference Plannihg Committee * * ' . 

Oirk Chipman Unitfed States Office of Education, Region V 

John Dobbs Michigari Department of Education 

George Crimes Wayne Co^^nty Intermediate School District 

|ohnO»bome Michigan Department of Education 

Allen Zoodlak Detroit Public Schools , . 

lafhet A. Winter, Chairman CEMREL, inc. 

UndaOwnpbell CEMREL, Inc. , . _ 4 

.VtemaC.Sm"*' ■ CEMREL,1nc. ■ ' '^.^ . -'- >^':^^^^^^^ 
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REGION X 



Kirgional Invitational Testing Conference 
April 30-May 1, 1979 
Thunder bird Inn at the Quay 
Vancouver , WA 



■il: It is desired that the conference will result in 

ircreasec knowledge of (a) quality test practices an 
(b) regional testing concerns among all participants 



APP.il 30, 1979 



Activity Location 

Registratiovi Lobby 

Coffee • Exposition Hall 

<^ 

WZLCCMS Exposition Hall 

Dean H. Nafziger, Director 
Division of Evaluation, Research 

and Assessnent 
Northwes'b Regional Educational 

Laboratory (NWREL) 

Allen T. A?0(^3ca 
Regional Ccnmissioner of 

Educaticoal Programs 
HEW Region X 

Robert ?. Rath 
Associate Director 
Northwest Regional Educational 
Laboratory 

APPROPRIATE TEST USES Exposition Eall 

Eva Ba<er, Director 
Center for the Study of 

Evaluation (CSE) 
UCLA Graduate School of Education 

Break 

REL.ATrN-G TESTING TO IKSTRUCTION Exposition Hall 
Madeline Hunter, Principal 
University Elenientary School 
Lcs Angelas^ CA 

LwP.ch East BT'd West 

River RooTinG 
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Location 



1:3C- b:00 



5:45- 6:30 



00 
30 



TEliT DESIGN RELATIONSHIP 
TO INSTRUCTION 

Group Leaders: 

Michael Hiscox -'NWREL 
Evelyn Brzezinski - NWREL 
Betty Tomblin - NWREL 
Suzanne Hiscox - NWREL 
Randy Dem aline - NWREL 
Pegge'^Tille-HEW Region X Office 
Janes 3urry'- CS^ 
Linda Polin - CSE 



Meeting of chairpersons, 
presenters, and group leaders 
for Tuesday's sessions 

No Host Reception 

Dinner 

Congressional Perspectives on 

Testing 

Ri'kki Poster 
Legislative Assistant 
Senator Mark 0. Hatfield 



Group 1: ' Pcolside F.ocra 



G^oup 2 
o 

Group 3 



Gro^up 4 



Group 5 
Group 6 
Group 7 
-Chart Room 



After Deck 
Quarter Deck 
Chart Room 
Quayside 
Rocra 202 
Exposition Hall 



V7est River Room 

East and West 
River Rooms 
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^ r.-jlonal Invitational Tc-stirig Conference 

'ThjpferDird Inn 'at the Qu^v ' 
Vancouver , WA 



MAY 1, 1S]9 



Time Activity - ^ s Location 

8:00 Coffee * - ' . ^bcposition H^ll 

8:30- S:*45 Overview of the Day's Activrtie^ Exposition H^ll 
, Briverjy L. Anderson/, Director 

Assessment and Measurement Procfram* 
Northwest Regional Educational ^Laboratory 

S:45~ 9:45 STATS ANb DISTRICT TESTING 
PROGRAMS--- EXAMPLES 

Group 1 ^ Exposition Hall 

Chair : *" ^ * 

Robert Lehman, Director, Planning and Evaliiation 

I^ke Washington School District No. 414 r, 

Hadrriond, Washington 

Presenters : 

*^ ' Gerald Evans, State Superintendent of Public Instruction 
Boise, Idaho 

P:alph Uphus, EJ.en^entary Principal • 
^ Central Valley School District No. 356 

Sockans* Washinaton 

• Wayne Neuburger, Coordina^tor of Program E-valuaticn 
Eeaverton Schools. 
Beaverton, Oregon 

Group 2 ^ ' Chart Room 

^/ Ghal_r : ^ 

Clai r Bo'-r^iHn , Associate Professor 
' Bol^e State University « - 

co 1 s e / I da ho 
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Presenters : 



Gor^don Ensign, Supervisor, Program Evaluation 
Office of Sugierihtendent of Public Inscruction 
Ol^THpia,' Washington 



to 
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Tixe 



Activity 



Location 



'After Deck 



Vic Doherty, Assistant Superintendent of Evaluation' 

Portland Public Schools 
Portland, Oregon 

Group 3 

Chair u 

William P. McDougall, Professor 
Washington State University 
Pullman, Washington - 



9:45-10:00 



Presenters ; '/ . 

Louis 0. Strand, Dir^tor of Instr^uetion, 

Helena School District No. 1 

Helena, Montana 

Barbara Cole, Coordinator, Research 6 Ass.essmeit 

Oregon Department of Education 

Salem, Oregon ^ ^ 

Lee Kulla, Research and Evaluation Unit 

Edmonds School District #15 ' * ^ 

LynnwooS, Washington 

^ 

Break / Cof f«« served in room 

where ypur 10 o'clock 
ftessiorv is held 
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"Time 



Activi ty ' . Location . 



10:00-11:30 ^ PZRSPECTIVZS ON KEY TESTING ISSUES 

Group 1 After Deck 

Chair ; ' . 

William E- Connett, StatisticeririZonsultant 
Office 0f Superintendent of Public Instruction. 
Helena/ Montana 

Presenters : - ■ . 

Orvis StenSon, Dean of 'Guidance^ 

C. M* Russell High School ' 

Great Falls/ Montana 



Ted E. Gary, principal 

Hazel Valley Elementary School *' 

Seattle, Washington 

Lois Bealf Title I Specialist 

Northshore School District 

Bothell, Washington 

* • 
George Sitkei, Test Specialist ^ ^ 

Corvallis School District 509J 

Corvallis, Oregon ' " 

Mitsugi Nakashiraa, Assistant Superintendent 

Hawaii Departoent ^of Educatiot^ 

EonqlblUr Hawaii ' ^ 

Group 2 Quarter Deck 

Chair ; j 

Wayne Neuburger, Coordinator of Program EvaluatTori 
Beaverton Sdhocls 
Beaver ten, Oregon 

4 

Presenters ; 

Johii Armenia, Assistant Superintendent 
Selah $cttool pi^trict 
Selah, Washington 

Daniel Organ, Director ,o>Evaluati on Center 
Yakima School District #7 

Yakima, Washington ^ ^ 

Helen Hess, Title I Coordinator 
Sunnyside Elementary School 
Portland, Oreq,on 



O t 90 , 
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Ti-e / Activity Location, 

Jini Menzies, Principal 
Coupeville Hic^ School 
Coupeville, Washington 

.^anet Mann, Learning Disabilities Specialist 
Waver ly Elementary School 
. ' ^ * Albany r Oregon . , 

Group 3 ^ ^ ^oom 202 

Cbait ; . ° 

. , Michael D. Hi'scox) Research Speqialifet 

, V ^ Northwest Regional Educational Laboratory 

Portland/ Oregon ^ ^ 

Presenters : 

Robert Abbott, Associate 'Professor 
/ University of Washington • 
Seattle/ Washington 

Lee Wicklund, Director of Curriculum and Instruction 
North Bend Public Schools • ' 
North Band/ Oregon 

Conrad Bertfn/ Counselor 
Black^oot High School 
Biackfoot/ Idaho 

Thelma Solfcnan/^ Basic Skills Teacher—Title I 
McCarVer' School— Tacoma School feist. 
. Taccnar Washington 

Carlton Brysonr Mathematics Ghairnian 
^ . Benson Pqlytechnic High School. 

Portland, Oregon 



O ' 9T ■ ■ 



Activi tv 



Group 4 
Chair : 



Exposition Hall 



A 



Gordon Ensign, Supervisor, Program Evaluation 
J Office of Superintendent of Public Instruction • 
Olympia, Washington 
' ' " - ' i-, 

Presenters ; 

Willian McDougallr Professor 

Washington State University 

Pullman r Washington ^ 

Lai^ny NivenSr Counselor 
Siuslaw Middle School 
^ Florence, Oregon 

. yajughn HawkeSr Assistamt Superintendent 
Blackf cot School District #55 
Blackfoot^ Idaho ^ " ' 

Robert Lehman, Director, Planning and Evaluation 
Lake Washington School District No. 414 
Redmond , Washington • > 



Linda Tcitac, Teacher 
Sheridan Elementary 



> v-> - — ar y Sohc 

ner , Washington 



Group 5 



Quayside Room 



Chair 

Bar bar a Cole, Coordinator , Research & Assessment 
Oregon Departn^ent of Education 
Salem, Oregon 

Presenters ; 

Clair Bowman, Associate Professor 

Boise State University 

Boise, Idaho « 

Harold Kafer, Curriculum Consultant' 
Educational Service District 171 
Wenatchee, Washington 

Melba Worth, Vice President 
National PTA Region VII 
Milwaukie, Oregon * . 

Donald Langan^ Director of Instruction 
School District No. 5 

Kalispell,' Montana * 
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11:45- 1:15 



Activity 



Location 



Ea3t and W«st 
River Rooics 



Lunch 

J^egional Testing Resources 
Hyrum Smith, Director 
Division of Educational Services 
Regional Office of Educational Programs 
HEW Region X 



1:15- 2:20 DISCUSSION OF ^KEY TESTING ISSUES. 

Group I z Training and Resources After Decfk 
Moderator: 'Pegge Tille - HEW Region X Office 



2:20- 
2:45- 
3:45- 



2:45 
3:45 
4:00 



Grouo 2: Data Usefulness-* 



Quarter Deck 



Moderator: Betty Tomlin - NWREl2 ^ 

Group 3 : Integration of Testing Quayside Rcom 
'with Instruction 

Moderator: Suzanne Hiscox - NWREL . 

Group 4: Integration of Testing •Room 202 
with Administration and^ Program v 
Evaluation 

Moderator; Randy Demaline - NWREL ^ 

Group 5 ; Test Development Chart Room 

Moderator: Mike Hiscox - NWREL . 

Group 6 : Test Selection Exposition Hall 

Moderator: Evelyn Brzezinski - NWREL 



Group 7 : Control of 
Testing 

Moderator: Jini'^ Hurry - CSE 



Pool side Room 



Refreshments ^ Exposition Hall 

Group Reports" to Total Conference Exposition Hall 
Closing Activities Etxposition Hall 



UC 
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AGENDA 

. ' Region VII ani VIII TESTIIsG C0.^7FER£NCE 

May 7 and 8, 1979 ' ' , 

Sponsored by : ^ , 

The :^J.d-continent Regional Edacatid(jial Laboratory and the Re-^ional Offices' of 

Hducarional Programs vil 'and Vlll 

Meeting Location: . 
The University of Hissouxi Conference Center ^ . 

5100 Rockhill Road 
Kansas City, Missour.i 

) 

Monday, May 1, 1979, 

a:3C^-?:15 Coffee/Registration * 

9; 15 Welcoming Remarks ' . 

Harold Blackhurri, Comziissioner OE Reigion VII 
John R^jn.kle, Commissioner 0£ Region VIII' ■ > 

9;3C Introduction t© the Morning Session * 

Edward Larsh, Dissemination Director, OE Region VIII ' 



9^4 5 Uses and Abuses of Tests, and The Relationship of Testing to 

Ins truest ion. ' ' y * 

VJillia.T. Ccffnsan, Iowa Testing Programs/ University of Iowa 

i'J:30 Broak * 

Xj.45 - Uses and Abuses of Tests, and the I^^lationship of Testing to 
^ Ix':str"t2c bion, continued 

Debprah Mei^r;- Principal, New York City 

11:3C Questions and Discussion 

11:^0 Lanch 

Remarks^ by: Dr. John Runkle, Commissioner OE F.egion VIII 

* ' f\ ^ 

l:OC . Panel Discussion: Issues in Testing. 

Willard Foster, Kansas State Department of Education 
Robert Benton/ Superintendent of Public Instmction, Iowa 
Alan VTheeler,^ District Superdntendent , Kansas City, l!0 

? Ball, District Superintendent, Shawnee Mission, Kansas 
Charley Foster, Mis'souri Department of Public Instruction 
Moderated by: Dr. Harold Blackburn; Commissioner r CE Region VII 



2:00 Keynote, Senator ThoriB^ Eagleton 

Chair: Higgins^ PRO 

« ^ 
3:15 Break , 
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Center for the Study of Evaluation Workshops on selected aspects 
of tes-ing 

Wc-rkshop leaders: 

J'ldv'^ Hamilton, Specialist / .Secondary Guidance & Competency 
Based r-aucacitsri/ Kansas State Department of Educ/iition 
D^vi»"i Director/ Guidance/. Counseling & T«sr,ing/ Department. 

o^J: Public Xnstr^action/ North 'Dakota 

Rocrer Hudson/ Director/ Student Personnel Services, Nebraska 
state Department of» Education 

JfliBes Hansen/ Z^puty Superintendent/ Division of Elenentary ajid 
Secondary Education/ South Dakota 

Social^ Hour j 

Dinner 

Reiflaurks by: Lachran Nixon, Director, Mid- continent Regional 

Educational Laboratory (McREL) 
Chair: C.!-* Hutchins, Deputy Director, McREL ^ 



\ 



4 



m 



8:30 Coffee - ^ 

9:00 Minijnuin Competency Testing: State of the ^t and State 

of the Region. / • ^■ 

Chris Pipho, Associate Director , Department of Research and 
^ Information, Education Commission of. the States 

• Chair: ?oger Hudson, Director, Student Pers^nel' Services , 
Nebras/^a Stace Depdr:iixient of Sdiication 

10:00 -Break 

r 

10:30 Improving Instruction Through Testing* 

Dale Scannel-1, Deaii' of Education, University of Kansas 
Chair: Judy riaAlton, Speo^ialist, Secondary Guidance and 
Competency, Based \duca1:ion, Kansas'State Department of - 
Education 

12:30 . Lunch: (Remarks by Dot Wolfe, Region VIII, Andrea King, 

Region VII, anolj Linda Sikorski, McREL on HZW 
reso'orces a^all^^iile in the region) 



-2:15 Snail Group * Sessions : 

1. Utah Statewdde Educational Assessment Model - Cognitive 
^ *ana Process Measurement-. 

David Nelson, Coordinator, Evaluation & Planning, USBOE 
'chair: Linda Sikorski, Director, McPJSL Regional 
Exchange * * 

2. Evalzaticn vs. Testing: Distinguishing Instructional 
Ciitcc:r.es a-:i Learner Outcomes- 

Don Cox, AFspc iate Superintendent,, Iowa SDI, 

Chair; Charles Foster", Director of Pupil Personnel, 

Missouri Scata Department of Education 

3. The Role of Testing and Evaluation in Educational 
Accountability, Bill. Dean, Assistant Commissioner, 
Colorado State DepaBtment of Education 

Chair: Diane Proctor Coordinator of Program Evaluation 

an'^' Research, Jefferison County Public Schools 

' " . \ 

A. The Use of Test Data in Mii^ouri's Instructiona^^ Manage-- 
ment System. Richard King, Coordinator of Curriculum-, 
Missouri State Department of Education. 

Ch2ir: David Lee, Director, Student Personnel Services, 
Nebraska State Department of Education 

Criterion Referenced Testing Interpretation and Use of 
Test Daik. Dale Foreman, Council for REAL Education. 
Chair: Janes Hansen , Deputy Superintendent, Division 
of Elementary & Secondary Education, South Dakota 

6. Alternatives to Standardized Testing: « Why and Whdt. 
Bernard McKenna, NEA. * 

Chair: C.L. Hut chins. Deputy Director^ McREL 
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If -J. IS Worr-.shops 



3:15 



Wr2.p-Up; Ijiplications for Meeting ^FeBaral Requir-ements 
Ton Keyas, Program Officer, Tlightrto-Read 
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REGION IX 



Monday Ma^y 14 

8:30 

.9:00 
Savoy. . 



10:30 



12:00 
Riviera/ 
^Versailles 



r:15 - 5:00 

Savoy 

Riviera 

Pompano 

Guslafider 

Marco Polo 

320A 



5:00 

Poolside 

6:30 
Riviera/ 
Versail les 



• NATIONAL IKSTITUTE OF EDUCATION 
REGIONAL CONFERENCE ON TESTING AND INSTRUCTION 
Airport M£rina Hotel 
-Los Angeles, California' 
. May 14-15, 1979 



Registration 

WELCOMING REMARKS . ' ' Q 

Eva L. Baker 

Director, Center for the Study of Evaluation 

INSTRUCTIONAL' IMPLICATIONS OF TESTING 
JMadeline Hunter 

Principal, University Elementary School, UCLA 
Coffee brea,k 

• ' ' ' . ^ 
THE USES AND ABUSES OF ACHIEVEMENT TES^S 
Peter Arasian 

Professor of Education, Boston College 
LUNCH 

SUMMARY OF MORNING PRESENTATIONS AND" FOCUS FOR SMALL GROUP 
SESSIONS James Burry,. Director of Field Services, = 
Center for the Study of Evaluation ' 

PRACTICAL methods" IN TEST SEL'tCTION, DEVELOPMENT AND USE 

These small group sessions will use materials developed for 
the conference to >provide training in the following areas: 
How to write domain-referenced "test specifications, methods of • 
assuring test items* congruence with domain specifications, 
comparing tests' relevance for a given curriculum, ind technical 
and practical qualities of tests. ' ■/ 



After the training, the groups will develop recofnnendatroasyon 
the themes of testing and instruction to be brought to the 
attention of the. National Institute of Education. 

NO-HOST SOCIAL HOUR 



DINNER ^ " ■ 

c 

Michael Timpane, Deputy Director, National Institute of EdQcatlon 

Following Dr. Timpane's remarks, the session will be open for 
a dialogue on federal policy on testing and instruction. \ 



8:30 



CONFERENCE ADJOURNS FOR THE DAY 



ERIC 
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Coffee 



SESSION MODERATED BY: Richard Schutz, Director , 
SWRL Educational "Res62»"ch and Development. » 

■ THE Process and politics of a successful domain-referenced 

TESTING SYSTEW < ' ^ 

Jerry George, Administrator of Glendale Management Systems, 

Glendiale (Arizona) Union High School District 

TESTING IN A LARGE METROPOLITAN SCHOOL DISTRICT 
Harry Handler 

Deputy Superintendent, Los Angeles Unified School District 
PROJECT TORQUE 

Judah Schwartz, Professor of Engineering Science and Education, 
MIT and Co-Director, Project TORQUE, Educational Development 
Center, Newton, Massachusetts 



Samuel B. Kemiosoian 

Regional Commissioner, Intergovernmental and Special Services 
USOE-Region IX, San Francisco 

SENSE OF CONFERENCE^ PAN EL 

The following panel will summarlze^issues presented atthe 
Conference and other issues in testi~ng^nd instruction for the 
attention of the National Institute of EcltrGa^ion^. 

Representative of the National Education Associations MELBA KNUTSEN, 
Chairperson, Curriculum and Instruction, California Teachers 
Association. • 

Representative of School Administrators: CAROLYN DEOLDEN, Director, 
Testing arid Evaluation, Hacienta-LaPuente Unified School District. 



RepresenHtive of the American Federation of Teachers: tllLES 
MEYERS, Oakland School District and Bay Area Writing Project, 

Representative of State Education Agency: ALEX LAW, Director 
Office of Program Evaluation, California State Department of 
Education. 



Speakers and participants are encouraged to remain in the 
Savoy room and continue discussions. 

END OF FORMAL AGENDA 



LUNCH 
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12:0(^1:30 Banquet Luncheon % * 

sSSSkSr*"^^^^ ^ Agenda 

Dr. Zadiarle Clementf 
Atfociafe Professor of EducatjkKi 

University of Vermont ^ 

REGION III 

1:30-3:30 WHERE DO Wt CO FROM HERE? 
Speaker: 

Dr, Egon C Cuba 

' Professor of Education - . ^ 

Indiana University ^ I 

Dialogue 

Dr. Egon C. Cuba * ^ . 

Dr.^'james Bunry 

Regional Worfcs^ Leaders 

3:30 Ad)oum 



Conference on 
Testing and 
Y Snstructlon 



June 4 & 5 



ERIC i i J 
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Haverford College Conference Center/June 4th ^nd 5tfi 



Day 1 Morxiay, June 4 



8:^ Coffee/p«stry 

Foyer-Stokes Auditorium 

8:30-9:30 Registration 

Foyer-Stokes Hall 

9:30-9:45 Welcome 

Dr. lohn E. Hopkins 
Executive Director 
Research for Better Schools 

- 9:45-10:45 TESTING 
Speaker: 

Dr. Ronald Edmonds . 

senior Assistant to the Chancel- 
lor of Instruction 

Board of Education of the Qty 
of New York 

10:45-11:00 Break 

11:00-12:00 INSTRUCTION 
^ Speaker: 
3 Dr. Maddlne Hunter 

Principal 

University Elementary School 
UCIA 

12:00 Noon No-host Lunch 

Hiverford College Dining 

Center .'U 

Speaker: 

Dr. Albert C. Crambert 
Commisrioner 
HEW RegkHial Office of 
Educatiofial Programs 



1:30 



1:30-3:15 



ERjCl . .. 



Concluding Remarks 
Dr. James Burry 
Project Director 
Center for the Study of 
Evaluation/UCLA 

Test Design jind Relationship to 

Instruction 
Training S^sions 
Participant will divide into 



Day 2 Tuesday, June 5 



Crp 1 Dr. Midiaet Kean 

Crp 2 Dr. Ed Patrick 

Crp 3 MSj |af>e Robem 

Crp 4 >4r. Mkhael Simeooe 

Crp 5 Dr.lban Buttnm 

Crp 6 Dr. Undih Polln 

Crp 7 Dr. John Bowers 

Crp 8 Dr. Sharon Tumulty 

Crp S Dr. Marshall An>«quita 

Crp 10 M». Marilyn Craig 

Crp 11 Dr. Ed Richards 

Crp 12 Dr. Sue Root 

Crp 13 Dr. Daniel Austin 



Room 

Bryn Mawr Rm-Dining Ctr 
Swarthmore Rm-Dining Ctr 
Sharpless Rm-Dtning Ctr - 
Smith Rm-Dining Ctr 
Pendle Hill Lounge 
Faculty Dining Room 
Stokes Hall #121 
Stokes Hall #22$ 
Stokes Hall #254 
Stokes Hall 9303 
Stokes Hall 9315 
Stokes Hall #319 
Stokes HsrII #326 



Foyer-Stokes Hall 

Sunken Lounge-Dining Center 

3:30-5:30 TEST DESIGN AND RELATION- 
SHIP TO INSTRUCTION 
Training Sessions - resume 

5:30-6:30 No-host Social Hour 
Sunken Lounge 
Haverford College Dining 
Center 

— 6:30— No-hostilirmer ' 

Haverford CoIIe^ Dining 
^ Center ' ^ 
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*8:30 Coffee/pastry 

Foyer-Stokes Hall 

9:00-9:15 Welcome Back . 

Dr: Albert C. Crambert 
Commissioner 

HEW Regional Office of Educa- 
^ tional Programs 

.9:15-10:15 WHERE ARE WE NOWT 
Speaker: 

Dr. Henry M. Brfckell 
Director 

Policy Studies in.Educatlon - 

10:15-10r30 Break 

Sunken Lounge-Dining Center 

10:30-12:00 ISSUES IN TESTING 

Problems and Concerns of 

Regional Areas 
Workshop Leaders: 
Dr. J. Robert CoWiron 
Bureau of Planning and Evalua- 
tion, Pennsylvania Dep;^rtment 
of Educjition 

Or. Thonfus Corcoran 
Executive- Assistant 
Office of the Commissioner 
New Jersey Department of 
Education 

Dr. John L Crew 
Superintendent of. Public 

InstructkMi, Baltimore City 

Publk Sdiooh 

Dr. Vlrg !nla L Dilton 
Virginia Education Association 

Dr. Willlan McCormick 
State Supervisor of Elementary 
Education, Delaware Depart- 
ment of Public Instruction 

Dr. Richard M: Pctre 
Assistant Deputy State 
Superintendent, Maryland 
State Department of Educa« 

1 ? ; 



REGIONS 1 AND 11 

Northeast Conference on Testing and Instruction 

The Bos"ton Park Plaza, Boston, Massachusetts 

AGENDA 



^.l^lnAv.• in June 1979 
7:00 PM - 8:00 PM 



Monday. 11 June 1979 - 



Registration^ Mrzsanino 



:W!8:0J^ 



o 9:H5 AH - 10:00 AM 
10:00 AM - 11:30 AM 



9:00 AM - 9:'<5 AM General Session. Ballroom west, 

■ Welcoming 'remarks - 

Dr. Thomas Burns, ROEP !• " 
. Dr. William Green, ROEP II 
• Dr, David P. Crandall, The NETWORK 

Introduction. to the Agenda: 
Leslie Merger t. The NETWORK 

BREM. Mezzanine 
G^NERAI - Session . Sallrocm Weet 
Dr. Peter Arasian, Boston College, Uses and 
Misuses of Standardized Achievement Tests 

Dr. Eva Baker, Center for the Study of Eval- 
uation, Relationship of Te^sting to Instruction 

Dr, Judah L. Schwartz; MIT, Education Development 
center; It Is Possible To Do It Differently: 
PROJECT TORQUE, an Illustrative Example 

Genfrai Session (Cont'd.) 

Questions to Panel: Dr. Thomas Burns, Moderator 
Participants will have the opportunity to 
question the testing and instruction panel. 

LuU£il, Stanbro Hall 

Smail Group Training Sessions . Fourth Floor 

Participants will brea,k into small groups to 
work with packaged materials. Module I 

g££^^ Fourth Floor Laftdiru} 

Small Group Traininr Session s, fourth Floor 

Participants will reconvene in small. groups to 
work with p.tckaged materials. Module I] 

No Host Social Hour . P<u'ior a ' 

DiMERi Georgian Rqom 



11:30 AM - 12:00 PM 



12:00 PM 

1:30 PM 

3:00 PM 

3:15 PM 



1:30 m 
3:00 PM 

3:15 PM 
5:00 'PM. 



5:00 PM - 6:00 PM 
6:30 PM . 



TnF<^nAY. V Jii NF 1979 



REGISTRATION^ ^ 
8:30 AM - 9:30 AM 



9:00 AM - 9:15 AM Mezzanine 

5:15 AM --10:00 AM General Session. Ballroom we,t 

Opening Remarks y 
.David Max McConkey, The -NETWORK / 

Dir., Research & Assessment, HA Dept. of Ed. 

> Fourth Floor 



Dr. 



A; 



C. 



D. 



Les May, Assoc 

10:00 AM - 10 f 55 AM PRESENTATIONS.^ ^ . 

Participants may choose one of the following sessions; 

(Room 433) Monitoring Student Progress on Instructional 
Goals, Corrine McGulgan, The 'NETWORK ^ 
(Room 436) Resources- In Testing ^ • 

• ERIC (Educational Resources Information Center) and 
Educational Testing Service; Barbara Wildewuth, ERIC: ^ 
Trt, ETS Test Collection 

• Educational- Products^ Infonwtlon Exchange, 
James George, EPIE ' ' 

/Room 437) A Look at a State Assessment Program. 
Dr. Cynthia V. L. Ward, .Director ; Martha H. Damley; 
Dr. Ralph S. Dan1els\ Bureau of Research and Evaluation, 
Rhode Island State Department of Education 
(Room 402) Openness About Standardize Tests: Improving 
Coinmjnication with Parents and Students; William Corbett, 
Principal, James Russell Lowell School, Watertown MA 
(Room 4oe) Alternatives to Standardl^zed Testing; 
Dr. Bernard "McKenna, NEA; Otis Thompson, Maine Teachers Assn 

11:05 AM " 12:00 PM PRPSgWTATiaNS. Fourth Floi>r • 

Participants may chooise another selection from Sessions A-E, 

12:00 PM - 1:00 PM LUMCH. Batlrocm Ea»t 
1:00 PM - 3:00 PM Gpncrai Session . Balirom Mttt 
Panel Discussion: David Max Mc Con keyf Moderator 
Testing and Competency-Based Education: f^iltlple Ptrspectlves 

• Lydla Greenberg, State Testing Cpordlnator, fU.SUte Dept 
^ • >)ohn Powers, Superintendent, SU #56, Somersi«rth, H.H, 

• , Charlotte Ryan, Massachusetts Parent Teacher Assn 

• Otis Thompson, Maine Teachers Assn , 

Participant* are encouraged to question the panel on Issijes of 
testing,.aiw competency-based education and to respond to Ideas 
generated b'y conference presentations 

3:00 PM p^^^^^ your'^fuestlonnalre at the registration desk on the - 

^ Mezzanine as you leave. THANK YOU FOR COMING! 
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AGENDA 



Region VI Testing Conference 
June 21 and 22, 1979 

Sponsored by: 

Southwest Educational Development Laboratory, Houston ISO, 
.Center for the Study of Evaluation, UCLA, and 
the U. S. Office of Education, Region VI 

I The University of Houston 
Continuing Educat-ioh Center 
/ Universi-ty t)f Houston Hotel 

4800 CaJhoun Road 
o Houston, Texas 77004 



Thursday, June 21 
8:30 - 9:00 
9:00 - 9:30 



9:30 - 10:30 



10:30 - 10:45 
10:45 - 11:45 



Coffee/Reg i strati on 

Welcome: James H. Perry 

Executive Director 
' Southwest Educational 

Development Laboratory- 
Austin, Texas 

Ed Baca 

Regional Commissioner 
Region V'l ^ 
Office of Education 
Dallas, T?xas 

Billy Reaghn 
Superintendent 
Houston ISD 

. **Historical Perspectives on 
Testing" 
Wil liam Angoff " 

Executive Director for Technical 
. Development 

Educational Testing Service (ETS) 
Princeton, New Jersey 

Break ^ 

"Criterion Referenced Testing Bs 

an Educational Tool 
Jan Barnett 

Assistant Director for Appraisal 

Services 
Spring Branch ISD 
Houston, Texas 



LOCATION 
. 2nd Floor 'Lobby 
Constellation Orion 



Constellation Orion 



Constellation Orion 
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12:00 -IfOO 



1:00 - 2:45 



3:00 - 4:45 



5:30 - 7:00 
Friday, June 22 
. 8:30 - 9:00 
9:00 - 10:00 




ERIC 



Vicky Hfirdway 
Ijistructor 
Spring Branch 
Houston, Texas- 
Lunch 

"Enhancing the Test Taking Abilities 

of Inner City Students" 
Doris An'^lerson 
.President, Houston Teachers 

Association 

CSE Test Development Training 
(small grojip sessions) 
Group 1 
Group 2 
Group 3 

Group 4 , ' 

Group 5 
Group 6 



Zodiac Room 



Constellation Orion A 
Constel lation Orion B 
Hereniles 
Scorpius 
^ Saturn 
Jupiter 



CSE Test Development Training 
(small group sessions) 

Group 1 

Group 2 

Group 3 

Group 4 

Group 5 

Group 6 

Social Hour 



Constellation Orion A 
Constel lation Orion B 

Hercul es 

Scorpius 

Saturn 

Jupiter 

Aquarius/Pisces 



Coffee 

Topical Sessions 

/V. "Issues jn Testing and 'Teaching 
the CultOrally Different Child" 
Ernest Bernal 
Professional Associate 
Educational Testing'Service (ETS) 
Austin, Texas 

B. "Issues ia Testing and 

Teaching Gifted Children" ' 
Phil Powell 

Professor, Educational Psychology 
University of Texas, Austin 



Hercules 



Scorpius 



/ 



Children with Learning Disabifl ities* 



"Issues in Testing and Teaching 

)i|liti( 

Steve Larsen 

Professor, Special Education 
Uni-versity of Texas] Austin 



Saturn 
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"Implementation of A Bilingual 
Program in a Large Urban School 
System" 

Michael MauTdin 

Assistant Director of Research 

and Testing 
Houston ISD 

n 

Panel Discussion (1 chairman - 
representatj ves'from topical 
sessions) ^ 



Constellation Orion 



Constellation Orion 



Wrap-Up (Directions, Expecta- - , 

tions, Issues) 
Jim Burry 

Director of Evaluation 
Center for the Study of 

Eval uation 
University of California, Los Angeles 

Charles Nix 

Associate Comiiiissioner 

for Planning and Accreditation 
Texas Education Agency 

f^rticipant representatives from 
test development training sessions 



Constellation Orion 



\ 
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SOUTHEASTERN REGIONAl CONFERENCE 

on 

TESTING AND INSTRUCTION 

June 2^06, 1979 
Sheraton - Atlanta Hotel 
Atlajita, Georgia - 




CONFERENGE SPONSORS - 

The Southeastern Regional Council for Educational Improvement 
The National Institute of Education 
The U.S. Office of Education, Region IV 



ERIC- 
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AGENDA^ 

SOUTHEASTERN REGIONAL CONFERENCE ON 
TESTING AND INSTRUCTION ^ 
SHERATiii-ATLANTA HOTEL, ATLANTA, GEORGIA 

JUNE 24-26, 1979 

Suf)<tey, Jun« 24, 1979 

6iu0 Ridge 3 « 3:00 p.fn.-9:00 p.m. R«gi»tr*lion 

Pitdmoni 5:00 p.m.-^OO p.m. Briefing S«ssion for Cont«r«nc« 

' Preaanton and FacilKalors 



•Monday, June 25, 1979 

Biue Ridge B 8.-00 a.m.*5K)0 p.m. H*gist.ra<ion 
Georgia Bailrcom 



8:30 a.m.-12 Noon 
8:45 a.m. 



9:15 a.m. 

10:00 a.m. 
10:15 a.m. 



11.i15a,m. 

12:15 p.m. 
1:30-5.-00p.m. 

Facilitators 



1 


Blue Ridge A 


2 


Cumberland. B 


3 


Cumberiand A 


4 


Piedmont 


5 


Coastal 


6 


Great Valley 


7 


Suite 710 


3 


Suite 810 


9 


Suite 910 


10 


Suite. 1010^ 



First^Q#rmal SMtkMi 

Wttoo^ H. Vtus Slngletary, Aft3oci«t« Sup«nnt0od#nt, Geor* 
gia State Oepvtment of Education, Atlanta; Gaorgia 

Confararic* Purpoaa: Wayna Taagua, Suparintendent of Edu- 
cation, Alabama State Dapartment oj Education, Montgofnery, 
Alabama ^ 

•"Competency Tasting from a Chief State School Offlcar's View- 
point," Raiph' D. Turlington, Rorida State Department of Educa- 
tion, Tirilahasaee, Florida 

CoffM n . 

"Uses and Abusea of Tests and Testing," Frank Womef, Dimctor, 
Michigan School Testing Service, Ann Artxsr, Michigan 

**Using Testing to Improve Instruction/' James J. Gaflagrver, 
Frank Farter Graham Child Development Caoter, Chapel Hi)), 
North Carolina ^ ■ 

Lunch 

*T est Design and Relationship to Instructk^n'" 
Small 6roup Training Sessk:>ns 



Paul Wyiie, Alabama State Dapannnentof Education 
WiHiam C. Berryman, Alabama Sta^e Department of Education 

William Johnson, Arkansas State Department of Education 

Hugh ). Peck, Louisiana State Departm^t of Education 
James V. Soileau, Louisiana State Department of Education 

Vana Meredith, South Carolina State Department of Education 

ClarV Trivett, North Carolina Department of Public Instnjction 
HX Conner, North Carolina State Department of PM\c instructton 

Marrjyet Wet)er, Educational Testing Service, Atlanta 

Janice P. Smith. Florida State Department 6f Educatk>n 
Thomas H. Rsher,^r1da State Department of Educatk^n 

Jim Rurry, Canter for the Study of Evaluation, UCLA 

Linda PoHn. Center for the Study of Evaiuatton, UCLA 

John Evins. Jr., Kentucky State Dapartment o^ Education 
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5:00 p.m. 
6:0^^7:30 p.m. 



Ad)oumD«y1 

No Host Sodai Hour 
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OMt^ia BaHroom Wnt 



Tuesday, Jun« 26, 1979 , 

8:30 a.ni.*9:30 iLm. T«tt Dtslgn and Rtfationahtp to Instruction" continuad. ' 

, Participants will nconvn* with thtir original groups in original 
■ . ' poms. 

- 9:30 a.m.-1 0:00 a.m. Small Group Diacusaions on Tacting Isauai 



Georgia Bailroom 
West 



10:00 a.m. 



tOrlSNoon 
10:15 a.m. 



10:45 a.m. 



CoffM BrMk 



SMOod Q^Mfil SMSion 

"Compeiency testing froni a RegionaJ Commlsaioner's Vl^w/' 
William L Liwis, USOE RagionaJ Qommisak)n«r, Regioi IV, 
Atlanta, Georgia ^ ^ 

"Making Minimum Compalancy Programa Wp<K^ . 
A Pane) Qi9CU98k)n 



Gs<)yg:a EaiJroom 

\ 12:15 p.m. 



1:00 p.m. 



2:00 p.m. 



2:30 p.m. 



Richard C. Causey, AJabama State Department of Ed'jcatior^ 

ranei^'iviemDeTa. j 

Jim Burch, North parolina Department of PuWtc Instruction 

AJice Shrewsbeny, OwenstJoro, Kentucky >ndependent School 
Siystem 

James V. Solleau, Louisiana State Board of Education 
Thomas H. Rsher, Rorida Departrnent of Education 
Cameron Rncher, Unfrversfty of Georgia, Athens 



Luncheon 

Luncheon Address: ••What's Right with Arnerican Education,"' 
Harold .Hodgkinson, Director, Professionaf Institute, American 
Management Association. Wa^hHigton, D.C. , 

Summary and Conclusions: "Sense of the Confemoce," Charlie 
G. Williams, Superintendent of Ei^ucatk)n, South Carolina Stata 
Department of Education, Columbia, South Caroiina 



Adjourn 



Conference Planning Committee 



VVhIIam Johnson i^^. 
Arkansas State Departm&r,.'Of Edudatfon 

Janice P, Smith 

Florida Stat* Department ol Education^ 
E^lrabeth Creech 

Georgia State Department of Education 
Lloyd C. Smith 

Lo-Jisiana State Department of Education 
Jchn Ethrldge 

MisaissippI State Depi/rtment of Education 
Rax Pouncey 

''Mfaiissippi State Department of Education < 
H J. Conner 

North Qaroilna Department of Public instruction 

ERLC 



Robert R. Hill ' 
South Carolina State Department of Education 

Paul D, Sandifer 

South Caroiina State Department of Education 

Reese Johnson 
USOE, Region IV 

Corinne Scott 

National institute of Education 

John Lovegrove 
USOfe, Region IV: 

Marilyn Dowdy 
USOE, Region IV 
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Appendix C 



The Role of Testing.vi American Schools 
(bound separately) 



ERIC 
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Appendix D 



Making, Choosin,g and Using Tests: 
A Practicum in Domain-referenced Testing 
(bound separately) 
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Conference Evaluatton Summaries 
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CONFERENCE EVALUATION SUMMARIES 

Date Collection 

^Though not a part of the formal contract, CSB gathered evaluative 
information about conference activities in collaboration w.ith sponsors. In- 
formation-gathering therefore varied somewhat from site to site. For the 
Region V conference, an opinion form concerning conference value wa*s com- 
pleted by participants after the conference and returiied to the spon^sor. 
CSE materials were evaluated on a measure designed for that purpose. 

For the Region X conference, participant perception of the conference 
was one topic of a larger rpeasure 'developed by the sponsor. CSE materials 
were evaluated on the same measure as used in Region V. 

In the Region IX conference, both overall evaluations and materials 
assessment were collected at the same time that participant recomnendations 
about follow-up were made. 

In the conference for Regions I and II, the opinionnaire used to col- 
lect participant recommendations also provided space for respondents to 
write their comments regarding their conference and CSE materials. 

In Region VI, participants provided both rating data and written com- 
ments" about the conference and, about CSE materials. 

. Region IV participants responded to an opinionnaire asking for thfetr 
recommendations, and written comments on the conference as a whole and on 
CSE materials. 

Evaluation of Conferences Across Site 

Participants expressed enthusiasm about the speakers, the small group 
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workshops, ar^d the opportunity to elcchange Ideas with other colleagues, 
particularly at state and federal levels. This positive reaction that 
the RegionaT Conference was a fine beginning step confirmed participant 
requests to have a larger and wider audience for the conferences: more 
classroom teachers, comnunity leaders, and parents, as well as greater press 
coverage. , Other coiments described the financial difficulties most school 
districts experienced in providing funds for teacher released time, and 
asked for an extended conference in order to amplify the topics covered and 
to add others . 

Primarily, the participants wanted the conference extended to allow 
for more audience participation, so that they co^uld react to the information 
presented, voice their* problems- and needs, and take part in planning future 
conferences. Suggestions of this nature were made in such comments as "I 
need more time to absorb ""all these ideas,*' and "The pace needs to be varied." 
In general , the partici^pants viewed the conference as a good beginning of a 
•dialogue which they hope will be* continued between the local school personnel 
and the state and federal educational agencies, a two-way dialogue with po- 
tential to improve education and to foster better communication among all 

e 

involved. ^ ^- 

Evaluation of Conference by Site 

Region V : A questionnaire was mailed to the participants after the 

conference (59% return rate): 

The table below shows the results on five questions rated by the 
participants on a scale of 1-10 with 10 as the highest possible rating. 
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Range. 


Mode 


Mean 


Meaian 




3-10 
5-10 
"3-10 
. 3-10 
3-10 


8 

10 
9 
9 

- 9 


8 
9 
9 

8 


«* 

7.68 i 
8.80 '! 
8.07 
8.02 
8.03 





Question 

1. Content Quality 

2. Facility Quality 

3. Logistics Qual ity 

4. Format Quality 

5. Overall Quality 

Responses to two open-ended questions: • ♦ - 

1. Major Strength of the Conference^ 

•The most frequent answers were the quality of the presentations, the 
presentors, and the panelists. 

2. Major Weakness of the Conference 

The most frequent responses were "Test Design and Relationship to 

Instruction" and. "too much too quick." 

Preferences for an educational conference revealed: 

Item ^ Top Choice Second Highest 

Month of year October March 

Week'of Month Second 1st or 3rd 

Day(s)^of Week ' Wednesday Tues. or Thurs. 

Number of Days 2 . 2-3 * 

Hours per day - 7 * 5 

Sessions per day 4 • 6 

Mode of Presentation Mixed-varied • <> Small groups 

Catered Lunches Yes 78% * ^ 

Region X : - Participant response forms indicate that most conferees found 
the conference to be of moderate value (i.e., adjacent to the highest rating 
option provided). Asked if they would attend such a conference again even 
if there were a modest fee charged/ most participants chose the "maybe" option 
Feeling in the northwest appears to be that a totally regionally-based confer- 
ence would be a useful service. ^ 

No conference evaluations were conducted In the Region VII and VIII 
conference. « ' . 



Region IX : Most of the participants rated the conference to be of 

moderately high value (again, adjacent^Jto the highest rating option pro- ^ 

vided). Most of the participants responded positively to the possibility 

of attending another conference, even if a moderate fee were charged. 

Written comments received from Region IX participants- reflected: 

\ need for pre-conference- organizer/material s 

' more interaction between audience and .presenters ^ 

need for more teacher and community participation in'such 
, conferences . 

' expand to three days 

' need for further dissemination of issues covered 

A' 

^ No conference evaluations were conducted in Region I.II. 

Regions I and II : -Participants from .Regions I and II emphasized, that 
s-uch conferences must te timed to avoid a conflict with^the last week of 
the school year. Participafits also wanted more^ opportunities to interact 
in small group settings with all those who presented ideas, materials, and 
research results. They also desired more emphasis on how to use tests ef^ 
fectively fn relation to instruction, and a more in-depth explanation of 
the issues in testing. They would have liked more classroom teachers to 
participate and to attend (and funds to make this possible). They also 
wanted more take-home materials to be available, especially those materials 
and top|ts to which the speakers referred.- Other topics which 
they would have liked to discuss were: 
a) Alternatives to testing 
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b) Inrhouse micro-processing of evaluation and diagnostic 
■ procedures ''"^ 

c) Testing In relation to classroom Instructional objectives, 
and to students' motivation to learn, and to parents and 
the public and to curriculum 

d) Testing in relation to basic skills, to those students who 
can not be expected to achieve minimum competency, to special 

, '•' education students. 

The majority of the opinionnaire respondents agreed t|iat their confer- 
ence was well organized and worthwhile-, that the C5E training materials were 
helpful, the presentations interesting, that they learned ^omething they 
can lise, and tfrat Ideas were presented in a language appropriate to the 
audience. 

Region VI: Participants at this conference responded to an evaluation 
— a ; 

form which asked questions on: 

■ extent participant gained knowledge and understanding of 
testing and education 

• e;^tent participant gained some skill in development of 
c criterion-referenced tests through "tlSE materials 

• extent participant got information about testing and 
teaching special populations 

A. five-point rating scale ranging from "a great deal" to "not at all" was 
'used, on this instrument. Intervening points on the scale were not defined. 
In terms of the first Item — knowledge gain - 50% of the respondents in- 
dicated they had learned either a great deal or at least the amount of knowl 
- edge- represented by the point in the scale adjacent to "a great deal." 

In terms of the second Item — knowledge gained through CSE materials - 
25% of the respondents Indicated knowledge gains of "a great deal" or the 
next adjacent value. Sixty percent of the respondents lay In the top thre ' 
points of the scale. 

116 



In terms of the third item — testing and teaching special populations 



~ 40% of the respondents lay in the two most positive values. 

Region IV : Written responses from the Region IV conference indicated 
the following: 

the conference did not meet the expectations of some of the par- 
ticipants in addressing the relationship of testing to instruction. 
Too much time was spent in "getting to" the issue but not enough 
in addressing this, issue 

the materials on Domain-Referenced Testing for use in small group 
sessions was written in highly specialised terminology, and needed 
a testing specialist to interpret. Material written in common lay 
language would have been much more useful to the classroom teacher 

the broad diversity of levels in the small groups seemed to hamper 
CP making the most of the materials 

many participants had excellent experiences in the small groups, and 
even though there was difficulty with the Domain-Referenced Testing 
Book, the facilitation was excellent, and the sharing between and 
among participants was most beneficial. 
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Evaluations of CSE Materials Across Sites 

Participant responses to the CSE materials was quite positive regarding 
their usefulness and clarity. The most common theme throughout the confer- 
euces was to devote more time to explanation of how the materials can actually 
be used in schools, particularly by classroom teachers. Another common theme 
was to simplify the level of language of the materials. Qne other fairly pre- 
valent point was that the diverse professional backgrounds of the small group 

members also added to the problems of total group understanding, 

a 

Evaluations of CSE Materials by Site 

Region V : Participants at this conference responded to a five-point 
rating scale on *o ' ' ' . 

. the information in the module 

. the terminology used 

. the examples in the materials 

. the exercises in the materials 

The information on the following two pages shows how the participants re- 
sponded to these matters. 
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TEST COu'lP.ViCi: AFTEPNCON WOi^'-o'-IOPS 
Pa >"ti=si pints' Reaction Siieet 

ule Title: Domain Referenced Test Specifications 

Tie mr-^rmacion in ihis r'.odule wdj: 

v^r-y 3 4 very 

cisar confusin; 

* 

10 18 13 4 



very 2 3 4 totally 

useful useless 

15 13 n 4 2 



vecy 2 3 4 very 

int=restina boring 



Th2 ter-^inology used in these materials was: 
8 20 14 3 4 



2 o 4 • very 



—^.r- difficuV 



1 1 1 



e woak-tr-oij'g^ exsrT-.ples which are ijicluded were: 
6 15 . 13 6 6 



excel" 234 very poor 

lent 



12 



5Mffi_ 2 3 4 not enough 



Detroit 



cier.t 



The ex9rcise(s) included in this module ^was/were: 
5 17-17 7 L 



very 
easy 



1~ " 4 very 

difficult 



17 \ ■ 10 11 



Clear; 2""^ ' 3 . 4 unclear; 

appropriate inappropriate 
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TEST CC:;FEREMCE: after WI WGRiCSHOPS 
Participants* Reaction Sheet 



Detroit 



?iodule Title: 



Item Rating Scale 



1. Toe in-DrTidiion in in i 5. .lodul e '^di : 



very 
clear 



12 



12 



_L 



very 

'confusing 



very 
useful 



11 



10 



totally 
useless 



very T 
i n te^es t " n « 



14 



1 



very 
boring 



2. The terminology used in these materials was; 



JL2. 



s uc'^:5:le 



very 

difficult 



3. The woak-throudh exanoles v/nich are included were: 



excel- 
lent 



-18_ 



Very poor 



suffi- 
cient 



JXL 



_6_ 



3r 



not enougn 



4. The exercise(s) included in this.ir.odiile was/were: 
3 4 20 3 ,. 1 



Tiry" T" 3 4 very 



easy 



difficult 



2 8 16 4 T 

clear; iT" 3 , 5~ unclear; 
appropr-'2te inappropriate 

rn?r>- ""^^ iQo TURff OVER TC BACK. 

^hKjL ' i- Jo 



It seems that the information in the domain-referenced test specifi- 
cations module was wel4>^ceived; the terminology was troublesome to some 
participants; more time could have been given to the walk-through examples; 
•rjd that the exercises were aKo troublesome to some participants. 



For the -item- rating scale, somg\5nat similar patterns emerge/ 
^ Written comments by the Region V respondents suggest that for both ^ 
modules: 



. more explanation about the purpose/use of the materials 
is needed 

. materials need to be simplified 

• presenters need overhead slides 

. time for presenting materials needs to be increased 

. njaterials have potential but need a qualified leader 

Region X: Participants at this conference responded to the same measures 

as used at Region V. Results for domain-referenced test specifications and 



the item-rating scale are displayed on the next two pages. Responses are 
generally similar to those obtained at the first conference- 

The "negative written comments returned by, the Region X participants were 
similar to those received in Region V. On the other hand, respondents appeared 
to be more favorable toward facilitators (more time had been spent training 
them than in Region V). / * 




• language level is too high for some people 
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nsT co:;?£"e?;ce:'aft£r:joc;i workshops 

Participants* Reaction Sheet 



Vancouver 



Module Title: Domain Referenced Test Specifications 



\ery 
cl?ar 



21 



19 



1 



very 

confusing 



8 



very 
usefu"^ 



25 



15 



totally 
useless 



8 



20 



very 2 
interesting 



17 



1 



very 
boring 



fne ter^-irrlogy used in these materials was: 
8 25 14 6 1 L 



:^r-. 



very 

difficult 



. 3. T'-^c w:2<-through 6u=n?ies which are included were: 

8 19' 20 4 2 

excel- 2 3 4> very poor 

if:-t 

10 17 15 C.5 ' 6 



■—ff^ 2~ ,.3 4 , not enough 

C "i C M t 

4. The exercise(s) included in this nodule was/were: 
6 13 '22 ' . 9 



-rr 



very c 



T" 4^ very 

difficult 



9 1 24 __3 , 

clear; T~ 3 4 unc}eari ^ 
appropriate - inappropriate 

id ,,o .TURN OVER TO BACK 
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Kodjle Title: 



^TEST CC:i;E^£:;CE; AFTER.NCgN ViCX.<£HOP^S 

Pariic'ipants' Reaction Shset Vancouver 

Item Rating Scale 



1. ""ne irifirTia lion in chis .nodule wdS'; 



very 
clear 



20 



8 



very • 
confusing 



1 



very 
usefu ! 



19 



J. 



totally 
useless 



1 



very 2 

in terestinc 



14 



very 
boring 



Tr.e teJT^'inclocy used in these materials was: 
8 !4 ;8 2 



v^ry 
u'-.ier 



very 

dif ficul t 



3. The wc3'<-thro'JS^ e/.anples which are included were: 
6 " 12 14 5 2 



ex:e'l< 
lent 



very poor 



6 



n 



sul Ti- 
cier.t 



13 



1 



not enough 



4, The exercisels) included in this module was/were: 
5 9 13 2 2 



very 
easv 



very 

difficult 



10 



12 



1 



clear; 2 
appropriate 



unclear; 
inappropriate 
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Based on these data, first-round materials modification was begun (as 
described in the main body of this report). 

No materials evaluation was conducted at the.>Region VII tnd VIII 
conference. 

Region IX : Participants at thi$ conference used materials which had 
undergone some, modifications. While written comments indicated more time 
could have been devoted to the materials, the group facilitators were well 
received (all facilitators were CSE/UCLA staff who were thoroughly familiar 
with the materid'ls). 

No materials evaluation was conducted in Region III. 

Before the remaining conferences were conducted, another set of materials 
revisions took place, especially in terms of re-designing the facilitator's 
guide aa:ompanying the materials. 

Regions I and II : While the materials appeared to be more helpful to 
Region I and II participants, concerns were still raised about time allotted 
for instruction, the language level of the materials, the amount of time 
allotted to prepare facilitators, and the broad range of expertise among the 
members of the small group. 

Region VI : As indicated in the overall conference evaluations, the 
majority of the respondents indicated they had learned something from the 
CSE materials. No written comments were collected. 

Region IV : As indicated in the overfall conference evaluations, there- 
still appeared to be some .problem with language level, and mixed participant 
backgrounds in the training session can create a problem in terms of appro- 
priate manner of facilitator presentation. 
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As mentioned in the main body of the text, further development work on the 
CSE materials is anticipated, Amon^ the concerns that could be addressed 
are the issue of time allotted for training,, composition of groups, and 
training of facilitators/leaders. 
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Recommendations by Conference 
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RECOMMENDATIONS: REGION X 
Vancouver, Washington 

The following recomnendations were gathered 1n small groups working 

with a topically arranged form to list reconmendations in the areas of: 
data usefulness 

test selection \ * 

integration of testing with alfmini strati on and program 
eval uation 

integration of testing with instruction 
training and resources 
test development 
control of testing 

. Each small group, guided by a leader-recorder, was assigned one of the above 
topics ta develop recommendations. Group recommendations were as follows: 

Data Usefulness 

quartiles, stanines are preferable to an average score 

diagnostic a^d placement tests prov4de the most useful kinds 
of test data* 

competency data* showing starting points and rates of growth, 

need to be stressed more than they are . 

the way information on test v-esults- is presented is" more 
important than the type of data 

Inappropriate test use occurs when those who are trained to interpret tests 

' fail to do so; when feedback on test results gets delayed to teachers; when 

a single score determines placement or a curriculum; when students, teachers 

and schools are rated without a proper basis for comparison; when parents 

and students are not sufficiently Involved in reviewing the test results; 

when too much reliance is placed on paper-pencil tests. Instead of perform- 



mance-based alternative type tests; when tests do not match the curriculum; 
when tests are used for teacher evaluation.. Both students' test-wiseness 
and the lack of test-taking skills affect test scores. Tests do not measure 
high-level cognitive skills, such as the ability to analyze, synthesize and 
evaluate information. ' f 

'Appropriate test uses, which will improve the usefulness of test data, 
include: 

helping students improve skills 

' upgrading the quality of a curriciulum ^ 

' providing additional information for making decisions and 
' C(jfrfiparisons about students and curricula , \ 

* Vemoving mysticism and secrecy surrounding testing when re- 
porting test results to ^)arents, students and the public ^ 
^ It is necessary to establish trust and to explain the test 

results from a perspective of where- the student started, the 
present situation, and where the student is going. This 
means-,^^af course, that test "language" must be presented un- 
derstandably, in terms of the recipient rather than the test* 
specialist. 



Test Selection and Development 

In selecting tests at the local level, many staff personnel need to 
be involved: administrators, teachers, test special ists, counselors, and 
a p^nel to check fOr biases, as .well, as curriculum developers. The selection 
process should involve three steps: 

" decide on the piJrpose of the test 

/ have all schools taking the test be represented on the test 
selection committee 

• have all tests reviewed by a panel of teachers^ curriculum 
and testing specialists 



Several kinds of«.,ddditional tests need to be developed, such as:; 

• reading tests for adults 

• readily administered and scored tests for adults 

• short-term tests of student progress (e.g., one term develop- 
. mental reading teists: 

. ■ < ^, ■ . ' .. " ' . , ' . ■ 

• all sorts of tests for. low-achieving community college 
students ' 

Participants recommended /further* that the same school staff who select 
tests should also participate in test development, While technical assis- 
tance from state departments of education, item banks, an.d outside contrac- 
tors are all helpful, the perspectives of teachers and administrators! are 
necessctry to insure that test purposes are clarified, data are used appro- 
priately, and that the match between testing, and instruction\Js a good one. 
Teachers and" administrators can also offer valuable suggestions to enhance 
a srhooVs public relations by demonstrating a school's competence in in- 
novative ways* rather thanbyhe^^vy reliance on testing. 

Integration of Testing with Program Evaluation and Administration 

Integration of testing with program evaluation and administration, and 
with instruction, elicited the greatest number of comments from participants 
These two topics, along with test data usefulness,' were their three most im- 
portant concerns. To connect test results in a meaningful way to administra 
tion and, program evaluation, and to avoid misusing tests, participants em- 
phasized the need for additional training for program administrators, as 
well as additional responsibilities. The most salient and beneficial train- 
Ing would inclucle: , 

• proper selection, administration, and interpretation pf tests 



O . - 129 

RLC ^ 142 



• familiarity with the purposes of the test and the program, 
of test content and the effective use of test results 

skill and tact tn explaining and Interpreting test results 
to students, teachers, principals, the news media and the 
general public 

Participants were concerned about special problem areas which heeded 
critical attention in the training program: if program administrators be- 
come satisfied with the attainment of minimum competencies only* then this 
attainment becomes maximum, and all other competencies are Ignored. To ob- 
r-:,tain meaningful and valid data, a test's congruency with a given curriculum 
is crucial. The results of tests" designed to provide infonnation about 
groups of students should not be used for making decisions about Individual 
students. These examples of misusing tests and test results shoul'd. be high- 
lighted in the training for program admini Orators. 

Responsibilities of program administrators should include the following: 

continual program evaluation in order to generate valid data, 
e.g., discarding outdated tests, adding new ones, etc, 

coordinating test adminstration so that one test can share 
informational needs and serve multiple purposes; this in- 
cludes supplying data for administrators, evaluators, and 
teachers 

preparing and involving staff members, parents and all those 
affected by the testing. In planning the testing program, in- 
cluding inservice training, if necessary. The purposes of the 
test need to be stated, as well as a dlpscriptidn of the test 
content, how the testing will be accomplished, and how the re- 
sults will be used. Teachers, should have a chance to review ' 
the results before any action is taken; if results differ 
markedly from expectations, further investigation is warranted. 
Care is needed to avoid an over-reliance on test results. 
Tea(^ing students to Interpret their tests results, and to use 
this knowledge in making their own decisions, can benefit stu- 
dents as well as the progratn as a whole. 

program administrators need to use other testing and assessment 
techniques for program evaluation: information from staff and 
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the conmunity in addition to students, teacher/student ratios, 
.attendance and drop-out rates, informal conmunity surveys to 
generate subjective data and to substantiate or challenge ob- 
jective data, measurement of affective and psychomotor skills, 
longitudinal follow-up studies to track student performance 
. oyer h period of years. Information of ^his type would provide 
much more valuable results than an isolated, single assessment. 

Integrating testing with Instruction 

Similar patterns of recomnendations emerged in responses to questions 
about integrating testing with instruction. Although not stated specifi- 
cally^in terms of additional training and responsibilities for teachers^ 
the 'suggestions were clear: incorporate teacher involveroent in all steps 
of the testing program, and use test results for changes in the instruc- 
tional program at the classroom level. Teacher made tests should be used 
for individualizing instruction, flexible grouping^ quick program evalua- 
tion, providing feedback to students, developing student self-evaluation, 
and checking students* mastery of a skill • Teacher-made tests should not 
be used for inflexible grouping, or be the sole basis for grading or com- 
muni eating to parents. While other suggestions were given, such as improv- 
ing'and diversifying* test reporting formats, getting test results promptly, . 
using diagnostic test and competency scores, the primary emphasis was for 
increased staff participation in the testing and evaluatibn process. 

a 

Training and Resources 

Increasing the involvement of staff members, teachers^ as well as ad- 
ministrators, implies additional training. This impl icatjl,on was substan- 
tiated by the participants in their recommendations for preservlce train- 
ing for teachers in test construction and validation, incorporating test 
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results into Instruction, and prescribing subsequent instruction on the 
basis of test results. Teachers and administrators need inservice train- 
ing in presenting, using and interpreting test results. People who inter- 
pret test res!ul»ts to the public and to the news media should rece^^e spe- 
cialized training. Parents and community groups need to participate in the 
testing program as review panelists^ or advisory committee members. 

Control of Testing " ^ 

As to the control of testing, participants want clear state guidelines 
on .district responsibilities. Local districts should be responsible for 
determining what test information is required, what measures' are acceptable 
and how to find or construct the needed measures. The federal government 
should disseminate guidelines in clear language regarding compl iance issues 
, and questions of equity; it should not be involved in measuring student 
achievement. 
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RECWtlENDATIONS: REGIONS VII AND VIII 
Kansas City Conference 

Participants at this conference were asked to mail to the Total con- 
ference, sponsor recQirmendations that would be appropriate for follow-up 
at thelocal level, the state level, and the federal level. The following 
recommendations were made: 

Recommendations Appropriate to LEA 

Participants urged local school districts to conduct inservice train- 
ing for teachers, counselors and adr)iinistrators in (a) the use of test results; 
(b) the development of evaluation procedures and devices, and (c) the selection 
of appropriate testing instruments. Districts should also advise state de- 
partments of education on what should constitutie basic education and what 
tests. local districts accept as measures of goal fulfillment. Further, large 
city school districts should begin to examine other testing alternatives to ^ 
current testing approaches. One such alternative would be piloting goal- 
referenced tests which have been calibrated to an Item bank through Rasch 
scaling techniques. ^ 

Recommendations to SEA 

Recommendations to state department of education included: 

providing seed money to districts interested in exploring miea- 
ment alternatives to testing 

avoiding establishment of statewide testing programs, especially 
at the primary and intermediate grade levels 

' providing encouragement and knowledgeable support personnel to 
assist the schools In carrying out the reconmendations listed 
under local school districts 
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* conducting workshops to ftmillarizc educators with i broa 
range of 'eval uation techniques 

^ " using input from local school districts, specify what constitutes 
basic education in accordance with community expectations and 
standards within a given state 

"devising and implementing a series of tests that will be used 

for guidance purposes and measurement' of achievement, rather 

than using a single test to measure the de/jree of success 
attained. • 

Recommendations Appropriate at the Federal - Level 

At the federal level, parti.cipants recommended: 

* encouraging districts to explore alternatives to norm-referened 
tests for reporting program results (e.g.. Title I). Rasch 
scaling techniques have potential, and piloting of measure- 
ment systems enjoying its techniques should be investigated 
and supported 

* sharing of items and practljces of testing and assessment pro- 
cedures employed by other districts through sponsoring con- 
ferences similar to the one held in Kansas City 

* maintaining a "hands-off" policy with respect to either es- 
tablishing standards or measuring results 

' providing technical and/or financial assistance as requested 

' providing incentive for States to work with smaller school 
systems in the upgrading of evaluation procedures 

' continued upgrading of norm-referenced assessment. 
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RECOMMENDATIONS: REGION IX 
Los Angeles Conference 

The following recommendations were gathered in small groups working. * 

^wtth a topically arranged form to list recornnendations 1n the areas of: 

data usefulness 

test selection/development 

integration of testing with administration and program evaluation 
integration of testing with instruction 
training and resources 
control of testing 

Each small group, guided by a leader-recorder, was assigned one of the above 
topics to develop recommendations. 

The topic which Los Angeles participants stressed the most was the use- 
fulness of tests: how tests and test data have been misused in the past, 
and how they should be used in the future. Because tests have been inappro- 
priate for their intended purposes, and because test results have been- mis- 
understood by the general public, as well as by parents, administrators, 
teachers and students, the participants emphasized three prime areas which 
needed to be addressed: Integrating'of testing with instruction; training 

4 

^existing and additional personnel regarding appropriate test practices in 

<? ' -.^^ 

test development,' selection, and use; training existing and a dBttriGaaJ per- 
sonnel ]n tl^q dissemination of test, results so as to maxmize the effective- 
ness of those results for all those involved Mn the testing program. 

Although participants offered suggestions about coordinating testing pro 
grams from the local through the state and federal level, rost of the recom- 
mendations dealt with the three areas mentioned above. 
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Suggestions for connecting testing with instruction came In response 
to the inadequacies of typical standairdiz.ed norm-referenced tests. These 
suggestions included: increased^ teacher participatipn in test construction, 
selection, and administration; screening tests to determine their fit with 
classroom instr taction; establishing an area or district timeline coordi- 
nating the selection, construction and administration of tests, and the 
sharing of test results for the purposes of motivation, evaluation and re- 
mediation; and encouraging broad sharing of test results. 

To make test data more useful, participants urged additional training 
for all test consumers, research in how to use test results most effectively, 
and an emphasis on using tests to improve instruction. Training should in- 
clude clarification as to the purposes of the test, an understanding of 
what is being measured and what can properly be inferred. This training should 
have a practical orientation, and be conducted in a workshop mode, in order 
to give the teachers, administrators, students, the community, and the news 
^ media feedback on pilot programs. Such training would also allow input from^ 
all these groups for planning the year ahead. 

In addition to training, alternatives and modifications need to be de- 
veloped in existing tests and test data. The specific kinds of comments 
made on the topics of concern were as" follows: 

Usefulness of Test Data 

' test consumers need to know/ understand what is being measured and 
what can properly be inferred 

* use of multiple measures - tailored to needs of audience; need for 
good longi^tudinal data 

* increase student awareness of reason for testing 



• simplicity 1n reported information 
; avoid comparisons - e.g., in newspapers, etc. 

• districts need to identify w1«-th purpose of the test - e.g., to 
avoid bad testing practices ^ 

' need for study on what teachers can do to contact parents with / 
< . combined data sources 

; research study on the role and responsibilities of parents regard- 
ing the test sco,res x>f their children 

• letxchild, parent, coimunity see scores, for motivation and feed- 
back 

• flexible grouping 

• tests should p-ovide basis for instruction and teacher/student 
interaction 

Test Development and Test Selection 

• standardized tests do hot reflect what a district is doing. 
The assumption of a common curriculum is not valid, so stand- 
ardized tests should not bemused for comparison , ^ 

■ need for locally developed qriterion-referenced test that reflects 
local needs and the local curriculum, BUT, 

• need exists to compare with results of other measures occasionally 

• need nationwide information so boards of education can make com- 
parisons 

• nded'NIE to foster federal /state/local test cooperatioji 

Integration of Testing with Adminis tration and Program-Evaluation 

• testing to measure growth, within schooj referent as opposed to 

. between school comparisons, i.e., effectiveness of program, is r ^nj 

masked by comparisons . ^ ' , 

' inform lay/public about meaning of test data 

• test sensitivity to program goals and emphas'is should be considered 
in selection and use of tests fo»^ program development 
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Integration of Testing with Instruction 

nx)st useful tests to teachers are diagnostic — those which 
identify actual areas of weakness; including item analysis 
(so we can understand why a child made a particular mistake) 

scores should be organized by skills and subskills (diagnostic 
approach) 

increase teacher participation in test construction 

give end"Of-year test scores to children's new (current) 
teacher 

plan for remediation - use area or auxiliary staff 

in secondary schools, show scores to students (self diagnosis, 
self-remediatlpn, motivation) ^ 

in elementary schools, show scores to parents and students; show 
parents and aides, etc., how to remediate on specific skills 

* information is needed on specific weaknesses which whole groups 
or classes have in common 

give teachers, community, etc. test results as soon as possible 

assure close correlation between test items and curriculum 

establish an area or district-wide timeline which would include 
test administration, receiving and interpreting results, inform- 
ing community, remediation, ongoing evaluation, etc. 

Training and Resources 

* workshops for administrators, teachers, public at all levels 
in test use/misuse 

training programs via a network 

minimum 'day'^oncept - money for teachers 

Control of Testing 

do not tie funding to deficiencies because schools will not show 
results that cut off funding 

* federal, state, and local cooperation 
' NIE to foSteV economy in testing 
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RECOMMENDATIONf: REGIONS I AND II 




1 


Boston Conference 




\ Participants at this conference mailed their concerns to the Network 




1 on an opinionnaire designed to elicit their recommendations. These recom- 




' mendations are abstracted from the participants' responses to six open- 




1 ended questions listed on the opinionnaire form. These questions are: 




1. 


What do you consider to be the three biggest problems associated 




1 


with testing? 






How should the federal government be involved in testing issues 




1 


(i.e., research, conferences, materials development)? 




1 


ifow can state departments of education be helpful to school dis- 






tricts in technical issues (e.g., technical assistance, research. 






information exchange)? ^^^^^ 




4. 


How should testing be coordinated across the state, district, and 






schools to make testing efficient as well as useful? 




1 ^* 


What kinds of tests should be developed at a state or national 






level to replace existing standardized tests? 




6. 


Are there' any other comments about educational testing you would 






bring to NIE's attention or the Network's attention? 




Three Biggest Problems 




Northeastern Conference participants expressed most concern about mis- 




understanding dnd misinterpretation of test results. There was a wide- 




' spread sense that nobody understands testing' and some people iiere concerned 




about test publishers encouraging secrecy about tests. Most widely felt 




1 O 

1 







was concern about the misunderstanding of the public. There were several 
comments about teachers and other educators* need to know more about test- 
ing and how best to use it. These comments relate ve.ry closely to comments 
about trouble finding tests, especially standardized tests, that accurately 
address their instructional program. In some cases, participants felt that 
inadequate attention was paid to finding the *Vight" tests. There was also 
concern about teachers using test information appropriately, 

There was some skepticism expressed about test validity as well. While 
very few felt that tests were useless, many did mention validity or accuracy 
of the tests themselves as a problem. There was also some- concern that too 
much reliance was put on the accuracy of one test score and that alternative 
measures should be used, either instead of or in addition to standarized 
tests. 

Role of the Federal Government 

Concerning the federal government's involvement in testing issues, re- 
search received top priority. Specific research desired was developing al- 
ternative testing methods, improving instruction, coordinating programs , de- 
veloping local tests, and case studies on test use and misuse, The second 
highest priority for federal emphasis was as a conference organizer and sponsor 
the third priority was for the federal government to act as a funding agent, 
with materials development a close fourth. 

Role of State Departments of Education 

State departments of education can be most helpfuVto school districts 
on testing issues by providing technical assistance, by acting as an infor- 
mation exchange, and by doing research- The jnajority of suggestions indi- 
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dicated that the state should take a leadership role for developing test 
guidelines, better teaching situations and techniques for skill assessment. ' 

Test Coordination 

In terms of coordinating tests across the state, district, and individ- 
ual schools to achieve greater efficiency, the majority of participants * 
responded positively. Their suggestions all placed the state in the same 
kind of leadership role described In the above paragraph, but with the col- 
laboration of local school districts. While the recommendations stressed 
the need for local participation and input, as well as a tie-in to instruc- 
tion, participants wanted the advantages of contact with other districts 
and other successful programs, as well as the benefits of coordination in 
order to minimize duplication of testing efforts. The negative responses 
revealed participants* fears that increased coordination at the state level 
would create regimentation, emphasize testing at the expense of learning, 
and foster the political needs of the state instead of the individual needs 
of the students. 

Test Development 

Participants recommended that additional tests be developed, includ- 
ing performance tests other than paper and pencil, and alternatives to 
standardized tests. Some specif ic *tests needed are speaking and listening 
assessments, as well as tests measuring creativity, facts, opinions and in- 
terests - 

Other Comments 

The main thrust of these suggestions consisted of requests for NIE to 
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take leadership In fulfvHIng/rieeds for alternatives to the existing 
tfisting situation. Both students and teachers have been caught up In a 
cycle of frustration, dissatisfaction and failure In the hurry to meet 
public needs for "back to basics," and to test for state and federal reg 
ualtions. Specific needs they wanted NIE to take leadership to fill in- 
clude requests for: 

models based on a curriculum rather than on tests 

establishment of a staff who could provide on-site training, 
especially for small school districts. In appropriate uses 
of tests and test results 

* sponsor training programs and conferences to exchange and to 
disseminate additional assessment and evaluation techniques 
other than testing 

involvement of practitioners 

emphasizing testing as part of the learning process rather 
than as an end in itself 

inclfirding enrichment^ in the curriculum rather than emphasize 
only basic skills 
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* RECOMMENDATIONS: REGION VI ^ , 

Houston Conference 

At the end of the second day of the conference, during small group 
sessions, participants expressed their opinions and recomniendatlons on the fol- 
lowing specific questions regarding testing issues, expectations and directions. 
In each case the group leader recorded the views of those present, Recom- 
mendations on the questions are as follows: 

Biggest Problems Associated with Educational Testing 

The biggest problems associated with educational testing in the public 

schools, in the minds of southwestern participants, are: 

, ' using only one test (or only norm-referenced tests) as the sole 
basis for decisions regarding a student's program placement, or 
pass/fail grade 

using tests and test results for purposes which they are not 
intended or for which thoy are not relevant 

The first of these problems was mentioned by three different groups 

of participants; the 'second by two different groups. The problems listed 

•below were mentioned once by each group (each group consisted of anywhere 

between 10 to 30 peopTe): 

overcoming student indifference to testing 

interpreting test results in order to best improve instruction 

poorly constructed te\cher-made tests 

too much testing 

Vack of bilingual or foreign-language tests 
comparing students 

comparing school districts to promote bond Issues or to refuse 
to raise teachers* salaries 
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What Kind of Preservice/Inservice Training is NPPdPri? 

In order to promote beneficia T_a nd appropriate t est jj^se, participants - 

recommended that parents and all school personnel involved with students--- 
teachers especially—receive preservice training in the purposes of test- 
ing, test construction and selection, interpretation of test results, and 
how to use the results most effectively to improve instruction, TmIs train- 
ing should also be presented to students themselves, the school board, ad- 



ministrators, counselors and consultants. Inservice training is/needed for 



the same groups, for the same reasons. Test companies should receive in- 



service training also, regarding students' attitudes to standardized tests, 
and teachers' and counselors' opinions on test validity and on the time and 
costs involved in testing. 



What Test Scores are Most Useful ? 

The most beneficial- uses of tests were diagnostic tests for reading 
and for individualizing instruction. The most useful test scores are grade 



Some appropriate uses df test results included meeting federal program re- 
quirements and objectives relating to gains and losses, or changing instruc- 
tional design of program, e.g., from a reading program to ESL or oral lan- 
guage development program. 

Test Development at the State or National Level 

At the state and national level, test development is problematic. Par- 
ticipants felt that because of the diversity of student populations through- 
out the state and the nation, it is virtually impossible to develop a test 




equivalent scores, percentiles and norm- referenced results for Title I. 
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to assess all studjent populations accurately. Many doubted that state 
-l-evel—ew-teri on-referenced tests would be any better than the existing 
norm-referenced, standardized ones, and therefore advised against that al- 
ternative. Many others argued that only tests showing students* progress 
1n learning should be developed. Participants stated that the following 
tests, developed at the state or federal level, would be very valuable: 

' minimum essentials or .exit tests 

' teacher competency tests (with input from teachers) 

* tests which minimize cultural bias 

Test Development at the Local Level 

The greatest need at the local level, in terms of test development, 

is for criterion-referenced tests which reflect the local curriculum. The 

next highest priority is equally divided among the following tests: 

' short diagnostic tests not machine-scored 

' placement tests to identify gifted students and slow learners 

' observation of behavior in the affective domain, or tests which 
indicate peer relationships and self-worth. These are helpful 
in counselling and in placement. 

* bilingual tests 

* culturally non-biased tests 

* vocational aptitude tests 

' tests for composition writing, and for minimum essentials 

' alternative tests with non-verbal and/or manipulative sub- 
tests 

' tests that include sub-tests which may be used independently 
if necessary, where results are not locked into the total^ test 
performance 
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Selection of Tests at the Local Level 

As to the selection of tests used at the local level, ^11 tHose who 
peed to use what the tests purport to measure should be inlrlolved In test 
selection. This includes teachers,- eval uators, principals, counselors, 
consultants, and minority group representatives, in that order. One group 
of participants argued persuasively for teachers on the grounds that because 
teachers are (or should be) in the best position to know wtiat Instruction 
actually occurred in the classroom, they would know what test items accurately 
•reflected that instruction. This group argued further that for each elemen- 
tary-grade test, three teachers should be on the selection committee: one 
teacher at the given grade level, one teacher below the grade level, and 
one teacher above the given grade level. The three teachers would be able 
to act as a system of checks and balances for each other in choosing appro- 
priate test items and testing instruments. 

Kinds of Tests Most Needed 

The tests listed below were considered to be most necessary, but not 
readily available. Each kind of test was mentioned by one group: 
'bilingual tests 

'tests to identify students for placement in special programs, 
such as vocational arts 

'tests that are not culturally biased (although the group 
members agreed the results of such tests might not be useful) 

'short diagnostic tests not machine-scored 

'teacher' generated teacher competency tests I 

'compete|icy tests 

Other Concerns 

Some participants were concerned with the political uses of tests; for 
example, to get more funds. Others were concerned with an over-relidnce on 
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fnachine-scored tests, especially for children whose eye-hand coordination 
is not sufficTenlly developed to demonstrate val id resljTts usTf^^^ r^^^ 
sures. From the struggles to demonstrate accountability in a culture where 
everyone must succeed, a clearer awareness developed of the many ways that 
testing in the school situation has thwarted, regimented as well as revealed 
the lack of students' success in learning. Simultaneously, testing has in- 
creased the stresses on teachers and on students. 



RECOMMENDATIONS: REGION IV 



Atlanta Conference 



At the conclusion of this conference, participants completed a written 
opinionnaire on which they rated several statements about testing, listed 
the three biggest problems as'sociate,d with educational testing in the pub- 
lic schools, and commented on those aspects of educational testing which 
needed to be brought to the attention of NIE. 

These comments, expressing much concern about the effects of testing 
on children, teachers and on the teaching-learning process, provide^ an ap- 
propriate context for the subsequent recommendations. While participants 
acknowledged the value of testing, they identified some major detrimental 
effects of testing on students: 

'too much faith is placed in a single, numerical representation of 
a student's ability or achievement. A student's self-concept can 
be severely damaged if he/she does not qualify as a result of taking 
tests. The primary use of test results is to help the student. 
Testing should not be a series of traumatic, anxiety-filled events 
every three years, but part of a continuous process of schooling. 

'because these negative effects happen to students in a classroom, 
their teachers and the entire teaching-learning process are also 
affected. The damaged self-concepts, test anxiety, and labeling 
caused by a single test score, the many tests taken whose results 
the student never sees--all these become part of the students' ex- 
perience, which then become factors that must be dealt with. 

'not only must teachers and administrators deal with the effects 
just mentioned, but they must utilize test results properly in 
order to improve classroom instruction and teaching practices. 
When "basics'' are emphasized, creative teaching tends to get 
smothered. Teachers need better undergraduate training in test- 
ing and its relationship to instruction, as well as continued 
in-service training. Because testing has become a high priority 
among policy makers, and because It is more of a polltlcil than 
an instructional issue at the present, teachers and ?idn1n1strators. 
need more time, involvement, training, resources and support to 
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adequately take on these responsibilities. Translating testing Issues 
4n^tG-pal-i€y-and--1n-to clas^sroom Instruct ion -cannot happen wi thout ex- " 



tensive changes. 

The implication seems to be: if teachers and administrators do assume 

these tasks, the detrimental effects of testing will be ameliorated to a \ 

c 

great extent. 

When southeastern respondents rated seven statements on testing (Item 
6 on the Opinion Porm), a large majority (60 to 95%) agree that: 

1. State departments should provide more technical assistance 
on testing to lotal districts. [ 

2. Teacher- training institutes should require all candidates for 
new or upgraded teaching certificates to take at least one 
course on testing* 

3. Alterna'tive ways to objectively assess' student competencies, 
besides , paper and pencil tests, are desireable. 

4. An expenditure of up to $10.00 per student per year would be-a 

^ worthwhile invfestment in a well-designed district testing program. 

The majority (52% to 7,7%) of respondents disagree with these statements:' 

1. The federal government should provide more technical assistance 
on testing to local districts. 

2. Teacher-made tests can eliminate the need to purchase commercial 
test instruments . 

The following statement: "One of the biggest obstacles to Implementing 
objective-based testing programs is the difficulty in keeping student records,' 
while receiving a majority of "agree" votes (52%), also received the high- 
est number of "disagree" votes (30%). Undoubtedly, this situation can be 
explained by the fact that responses to this statement depended on the school 
position held by the respondent. 

When the respondents' ratings are analyzed in terms of their position 
in the educational system, the interpretations of several responses change. 
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An investment in a district testing program, for example, is more impor- 
tant to teachers and principals than to specialists in evaluation and re- 
search. A higher percentage of teachers, principals, and actninistrators , 
compared to consultants and research specialists, view the maintenance of 
student records as an obstacle to 'implementing objective-based testing pro- 
grams . 

In the general conclusions and recommendations of southeastern parti- 
cipants, they agreed the Regional Conference on Testing and Instruction 
was **a successful first effort/' Howe^^r^i they clearly expressed a need 
for future activities of a similar nature, to address more thoroughly and 
practically the, relationship of testing to instruction. The following 
recommendatf5nsderi ve from their concerns and opinions summarized above: 

* more/ effort should be devoted to sharing experience-based knowl- 
edgje and expertise among teachers at both state and regional 
levels 

* federal and state policy makers need to broaden their perspectives 
about assessment to include alternatives to paper and pencil tests, 
and to acknowledge the immediate and long-range impact of testing 
on students' lives 

* 

* "growth-based subjective evaluation systems" need to be developed 

to avoid being^'guilty by 'default in recognizing the variety of skills 
knowledge and achievement that all students possess. This totality 
cannot be measured by one commercial instrument 

' while research results and materials developed from them are neces- 
sary, they must be couched in terminology readily under'^stood by 
teachers and made available at the building level 

* teacher preparation institutions need to include adequate training 
in testing for all teachers in teacher education programs 

" state departments of education and local school districts need to 
take a leadership role in resolving fundamental problems arising 
from testing and instruction issues 
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for all directives regarding assessment and testing programs, state 
departments of education and local school districts must provide the 
necessary support services— funds , inservice training, released time 
etc. , 

state level, as opposed to regiorjal, conferences on assessment will 
increase the probability of greater teacher participation 

the public needs "frequent, credible and comprehensible reports 
and information" on assessment programs * 

all educators must make efforts to insure that test results are 
understood and' used appropriately. They must also take care that 
students' self-concepts are notharmed by misusing test results 
and grades , ^ ^ 

educators must ''remain open to possibilities" in their efforts to 
demonstrate their accountability to taxpayers and governing bodies 
by creating assessment programs. They and we have a "moral respon- 
sibility to the future, as well as to the present," 
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REGZCW) V 



Cherry Hill School District: 
Dearborn School District: 

Ecorse School District: 
6«rden City School District: 

Grosse lie School District: 
Hamtramck School District: 
Harper Woods School District: 
Highland Park School District: 

Livonia School District: 

Melvindale School District, 

North Allen Park School District: 

North Dearborn Heights School District: 

Northville School District: 

Pl^outh-Canton School District: 

Redford Union School District: 
River Rough School District: 
Romulus School District: 
Southgate School District: . 
South Redford School District: 

Trenton School District: 
Van Buren School District: 
Wayne-West land School District: 
Westwood School District: 
knodhaven School District: 



Jim Potter 

Thomas McLennan 
Donald Hys * 

Claude, Inch 

Gerri KJessel 
Rich Witkowski 

Harold Streeter 

Tom Traywick 

Truman Guard 

Thomas Lloyd 
John Stindt 

Anthony Aquino 
Allan Edwards 

John M. Overhiser 

Barbara Bowen 

Nancy Soper 

David Rodwell 
Samuel Ulsaker 

Earl Wuestneck 

William McCollum 

Marvin Fischer 

Eugene Parsons 

Jan Jacobs 
Jack Knox 

Agnes Green 

Douglas Brown 

Clarisse Stafford 

Patricia Ammon 

John Schultz 
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Participants, Testing md Instruction Conference 
March 27-28, 1979 



Eva L. Baker 
^ (Speaker on Instruction) 
Director 

Center for the Study of Evaluation 
UCLA Graduate School of Education 
145 Moore Hall 

Los Angeles, California 90024 

Ms. I. V. Barrett 

Michigan Federation of Teachers 

13105 Sorrento 

Detroit, Michigan 48227 

Lois B artels 
Intern 

Training Program for Women 

and Minorities 
CEMREL, Inc. 
3120 59th Street 
St. Louis, Missouri 63139 

Ruth Bebemieyer 

Program Assistant 

Urban Education Program 

CEMREL, Inc. 

3120 59th Street 

St. Louis, Missouri 63139 

Robert Bess 

Michigan Federation of Teachers 

27378 Parkview 

Warren, Michigan 48092 

Charles E. Bidwell 

(Regional Resource-,28th only) 

Co-Director 

Educational Finance and 

Productivity Center 
University of Chicago 
5835 Kimbark Avenue 
Chicago, Illinois 60637 

Ed Sink ley 

Director of Research and Evaluation 
Metropolitan Nashville Public Schools 
2601 Bransford Avenue 
Nashyllle, Tennessee 37204 

Eugene J. Boruckl 

Illinois Federation of Teachers 

Chicago Teachers Union 

201 North Wells 

Chl^oo, Illinois 60606 
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Dr. Ronald A.* Boyd 

(Time Keeper) 

Associate Super Intcfident 

Indiana Department of Instruction 

State House, Room 229 

Indianapolis, Indiana 46204 

Alf reda Brown 

Resource Specialist 

CEMRa, Inc. 

3120 59th Street 

St. Louis, Missouri 63139 

Jim Burry r?* 
Center for the Study of Evaluaticfn' 
UCLA Graduate School of Education 
145 Moore Hall 

Los Angeles, California 90024 

William D. Callian, Jr. 
Assistant Superintendent 
Memphis City Schools 
2597 Avery Avenue 
Memphis, Tennessee 38112 

Linda Campbell 

Office Manager 

School & Community Services 

CEMREL, Inc. 

3120 59th Street 

St. Louis, Missouri 63139 

'Angel Ine Caruso 
(Response Panel) 
Associate Superintendent 
Department of Curriculum and 

Instructional Services 
228 North LaSalle Street 
Chicago, Illinois 60601 

Jean Caudle 

Wisconsin Education Association 

P. 0. Box 8003 

Madison, Wisconsin 53708 

Clark Chipman 

(Regional Resource and Response Panel) 
United States Office of Education 
Region V, 

300 South Wacker Drive 
32nd Floor 

Chicago, Illinois 60606 



Frances Coe 
(Response Panel) 
Commissioner 

Merqphls Bo&rd of Education 
Memphis City Schools 
2597 Avery Avenue 
Memphis, Tennessee 38112 

Pam Coe 

Research Specialist 

Urban Education Program 

CEMREL. Inc. 

3120 59th Street 

St. Louis, Missouri 63139 

David Cooper 
President 

Indiana Federation of Teachers 
8575 Zionsville Road 
Indianapolis, Indiana 46268 

John C. Craig 
Coordinator of Testing 
Illinois Office of Education 
100 North First Street 
Springfield, Illinois 62777 

Mr. Pat Daly 
(Response Panel) 
Teacher 

Edsel Ford High School 

20601 Rotunda 

Dearborn, Michigan 48124 

Harold Derderian 

Michigan Federation of Teachers 

34709 Bristol 

Livonia, Michigan 48154 

Theresa Denman 
(Response Panel) 
Mathematics Supervisor 
Detroit Public Schools 
932 School Center Building 
5057 Woodward Avenue 
Detroit, Michigan 48202 

Lorenza Dixon 
(Discussion Leader) 
Curriculum Coordinator 
Indianapolis Public Schools 
120 East Walnut Street 
Indianapolis, Indiana 46204 
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John Dobbs 

(Moderator, Response Panel) 
Assistant Superintendent 
School and Comnunlty Affairs 
Michigan Department of Education 
Lansing, Michigan 48909 

Dave Donovan 

(Response Panel-28th only) 
Director of Research 
Michigan Department of Education 
Box 30008 

Lansing, Michigan 48823 
Rcnald Edmonds 

(Speaker on Test1ng-27th only) 
(Senior Assistant to the 

Chancellor of Instruction, 

Board of Education, 

New York City) 
Harvard University 
Carrtbridge, Massachusetts 02138 

Doris D. Eldrldge 
(Discussion Leader) 
Director of Pupil Personnel 
Special School District of 

St. Louis County 
12110 Clayton Road 
Town & Country, Missouri 63131 

Charles Gavin 
Assxiate Director 
The College Board 
One American Plaza 
EvAnston, Illinois 60201 

James H. Gold 
(Susan Ketchum) 
Supervisor 

State Pupil Assessment 
Wisconsin Department of Public 

Instruction 
126 Langdon Street 
Madison, Wisconsin 53702 

Ed Gollnick 

Wjsconsin Education Association 

P. 0. Box 8003 

Madison, Wisconsin 53706 
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John H. Grate 
(Perspectives Panel) 
Director, Planning and Development 
Cincinnati Public Schools 
230 East Ninth Street 
Cincinnati, Ohio 45202 

George Grimes 

(Moderator, Perspectives Panel; 

Host, Conference Site) 
Director, Information Services 
Wayne County Intermediate 

School District 
33500 Van Bom Road 
Wayne, Michigan 48184 

Pauline V. Grissom 

(Testing and Instruction Panel-'28th only) 
Detroit Public Schools 
*5057 Woodward 
Detroit, Michigan 48202 

Opal Harris 
Member 

Michigan Education Association 
, 322 First Street 
Ypsilanti, Michigan 48197 

Nellie Harrison 
Curriculum Specialist 
Urban Education Program 
* CEMREL, Int, 
3120 59th Street 
St. Louis, Missouri 63139 

Dr, Harold Harty 
(Response Panel.) 
Associate Professor 
325 Education Building 
Indiana University 
Bloomington, Indiana 47401 

Dr, Robert Howe 
(Regional Resource-28th only) 
Director 
. ERIC/SMEAC 
3rd Floor, 1200 Chambers Road 
Columbus, Ohio 43212 

JiyJIa Hs1a 
Director 

Midwestern Regional Office 
Educational Testing Service 
One American Plaza 
Evanston, Illinois 60201 
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Sharon Ireland 
Minneapolis Public Schools 
807 N. E. Broadway 
Minneapolis, Minnesota 55413 

Marshall S. Kaner 
As soc 1 ate Super i ntendent fSr 

Educational Support Services 
Minneapolis Pubilic Schools 
807 N. E. Broadway 
Minneapolis, Minnesota. 55413 

Marian Kilb'ane-Flash 
(Discussion Leader) 
Supervisor, R&D 
Cleveland Public Schools 
1380 East Sixth Street 
Cleveland, Ohio 44114 

Sharon Koenigs 
Midwest Regional Exchange 
CEMREL, Inc. 
3120 59th Street 
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Terry Capen 
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BRODY-STRAUSS, Margaret 
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BROWNE, Dan H. 

Director, Planning A Evaluation 
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BRYSON, Carlton W. 
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2735 N.E. 38th 
Portland, 97212 

/ 

BRZEZINSKI, Evelyn 
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Portland, OR 97204 

BRZOSKA, Ellen 
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402 W. Nob Hill Blvd. 
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Bothell, WA 98011 
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Jefferson High School 
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Portland, OR 97210 

CLARK, Christi 
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CODISPOTI, Codle 
Educational Dissemination Specialist 
U. S. Office of Education, Region X 
1321 Second Avenue 
Seattle. WA 98101 



COLE, Barbara 

Coordinator. Rtstarch and Assessment 
Oregon Dept. of Education 
942 Lancaster Drive. N.E. 
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COLE, Mary L. 
Test Coordinator 
John Ball School 
4221 N. Wllfis Blvd. 
Portland. OR 97203 

CONNOLLY. Peggy 
Director of Testing 
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Portland. OR 97219 

COOK. Betty J. 
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Portland. OR 97230 

DAVIS. W. Robert 
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DeCOURCEY. Keith 
Guidance Director 
Centennial High School 
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Gresham. OR 97030 

DEMALINE. Randy 
Evaluation Specialist 
Title I Technical Assistance Centers 
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710 S.W. Second Avenue 
Portland. OR 97204 

DIMMITT. Norma 
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University of Washington 
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DOHERTY. Victor W. 
Assistant Superintendent 
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DUNCAN. Delores 
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2540 N.E. 30th 
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FLEMING, Joseph B. 
Assistant Superintendent 
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1871 N.E. Stephens 
Roseburg. OR 97470 



ERIC 



6NAIMSEGARAM, Joseph 
Principal 

Our Lady of Lourdes School 
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1151 S.W. Vermont 

Portland, OR 97219 

KAFER, Harold 
Curriculum Consultant 
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1272 S.W. Zivney Lane 
Lake Oswego. OR 97034 

McCLELlAN, James C. 
Special Projects Coordinator 
Winston-Oi 1 lard School District 
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Albany, OR 97321 

MILLER, Lorin 
Curriculum Director 
Quillayutc Valley Schccls 
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2150 S.E. Torbank Rd. 
Milwaukie, OR 97222 

MUNSELL, Paul R. 
Counsel or 

Veteran's Education Center of Oregon 
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U.S.D.E. 

601 E. 12th, Room 360 
Kansas City, MO 64106a 
Harry Kellman 
Dir., Dissemination 
Office of Education 
^^Kansas City, MO 6410601 
Jan Sutton 
Res. Asst, 
U-C.L. A. 

Los Angeles, CAK 
Ernest Jones 
Deputy Supt. 

St. Louis Public Schools 
911 Locust Street 
St> Louis, MOQI 
Eula All^n 
212 East Ray 
Salina, KS 67401M 
"^""Robert L. Lover idge 
Div. Assistant 
St. Louis Public Schools 
1517 So. Theresa 
St. Louis, MO 631048 
Jeanne Fox 
Kansas City Times 
1729 Grand Ave 
JUnsas City, M0« 
Hazel L. Henderson 
3731 Shreve 
St. Louis, MO 63115a 



REGION IX 

CONFERENCE ATTENDEES 



Karen Anderson 

Resource Specialist 

Los Angeles Unified School District 

Paul Allen 

Director of Elementary Education 
Mt. Diablo School District 
Concord, CA 

Peter Arasian 
Professor of Education 
Boston College 
Chestnut Hill, MA 

Eva L. Baker 
Director 

Center for the Study of Evaluation 
UCLA 

Jack Barry 
Glendale, Arizona 

George Behr 

SWRL Educational Research 
Los Alamitos, CA 

Mary Black 

Reading Specialist 

Los Angeles Unified School District 

Lorraine Bock 
Research Education 
University of California 
Graduate School of Education 
Los Angeles, CA 

Roger Bolus 

Center for the Study of Evaluation 
UCLA 

Pat Bryan 
Advisor 

Los Angeles Unified School District 
Qui da Brown 

Nevada State Education Association 
Las Vegas, NV 

Roberta Burk 

Coordinator/Teacher 

Los Angeles Unified School District 

Jim Burry 

Director of Field Services 

Center for the Study of Evaluation 

UCLA 



Stella Cable 

Coordinator, Pupil Services 

Los Angeles Unified School District 

Roy Cousins 

Assistant Superintendent 
Culver City, CA 

Susan Daniels 

Secondary Math Advisor 

Los Angeles Unified School District 

Eddie Deckard 

Instructional Planning 

Los Angeles Unified School District 

Trena Delia Gatta 
English Department Chairman 
Mill Valley School District 
Mill Valley, CA 

Caroline DeOlden 

Director of Testing & Evaluation 
Hacienda-LaPuente School District 
Hacienda Heights, CA 

Rugh Drye 

Title I Coordinator 

Los Angeles Unified School District 

Sara Duran 

Center for the Study of Evaluation 
UCLA 

Howard Eichinger 
Area 6 

Los Angeles Unified School District 

Ellen Feldman 
Wildwood Elementary 
Santa Monica, CA 

Donna Foote 
Teacher 

Lawndale High School District 
Hawthorne, CA 

Margo Fraser 

Nevada State Education Association 
Las Vegas, NV 

Del ores Gamble 

Instructional Advisor Area 4 

Los Angeles Unified School District 



189 



Jerry George 

Administrator 

Glendale Union High School 
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AEI?.'GTCN SCiOOL-DISTRICT 

A3I:♦GT^^, pa 

DR. RITA C. ALTMAN 

SCH'DOL DISTRICT OF PHILADELP-HIA' 

PHILADELPHIA, PA' ■ 

DR« M:ARSHALL AMESQUITA 
RESEARCH .PGR BETTER SCHOOLS 
PHILADELPHIA, PA • 

GAIL AJ-FEL 

UPPER U.^SY SCHOOL DISTI^ICT 
UPPER DARBY, PA 

DR. 3ARRY' ".APPARIES 
HEW REGIONAL OFFICE OF 
EDUCATIONAL PROGRAMS 
PHILADELPHIA, PA 

T 

DR. DANIEL AUSTIN 

PA. DEPT.\f EDUCATION- 

HASRISEURG, PA 

S\NDRA" L. BAKOW 

PA - IJITERMEDIATE UNIT 21 

SCHMECXSV'ILLE, PA 



ERIC 



DR. HELEN BAMBACH 

PERKICMEN VALLEY SCHOOL DISTRICT 

SCHWENKSVILI|, PA 

MR. LES BARNES 

UPPER DARBY SCHOOL DISTRICT 

Ul^PER DARBY, PA^ 

StEFHEN P. BARRET 

PA. DEPT. OF EDUCATION ^ 

HARHISBURG, PA 

DONALD C. BERNINGER 
MUNCY ELEMENTARY SCHOOL 
"MUNCY, PA 

beatrice biester 
interboro high sghool 
prospect park, pa 

robert bousquet <!. 
trenton board of education * 
trenton, n j , ^' 

dr. john bo;vers 

research for better schools 

philadelphia^ pa 

dr. gary l. bowman 
neshaminy school distolct 
langhorne, pa 4 

dr. george e. brei»1an. jr ^ 
pa. dept of education ^ 
haRrisburg, pa 

richard r. bricki£y 

RISE 

KING OF PRUSSIA, PA 

DR.v RICHARD BROTHERS 
EA^l^ENN SCHOOL DISTRICT ^ 
EmAUS, PA 

DANIEL BROWN 

NESRAMINY MAPLE POINT HIGH SCHOOL 
LANGHORNE, PA 



T80 -^^3 
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DR. H£:nRY M. BRICJCELL 
^LICY' STUDIES IN EDUCATION 
.NEW YORX, NY 

•HAROLD BL'RKE 
ALEUNDRIA CITY PUBLIC SCHOOLS 
ALEXANDRIA, -VA ' - 

•nKKAS J. BURKE - 

WILSON AREA SCHOOL DISTRICT 

'EASTON, PA . ■ 

# 

DR. J.AMES BtJRRY . . , 
CENTER FOR -THE STUDY OF 

•■,EVALUATION/UCLA 
LOS ANGELES,, CA 

■?iAa.{ I BUTLER 

MD. STATE DEFT OF EDUCATION 
EALTt'ICRE, Kb 

DR. JC.AN BUnUAM ' 

RS3E\RG-: FOR BETTER SCHOOLS 

PHILADEL'HLA, PA 

>JELLTi^3UE 

STT>CUD£BURG H^GK SCHOOL 
STRCUDS3URG, -PA'^ 

E.-i.RBARA CAFJELLO 
.PTA LECfsiA.TION CONt^ITTEE 
SCiiCOL DlRECTC'i'^ ELECT 
Wf OMISSING,«PA 

J?^T H. CALD'iVELL 

RESEARC-I FOR BETTER SCHOOLS 

PHILADELPKLA, PA 

' DR. MELVIN S. CARNEY 

ERIE SC-:COL DISTRICT • ~ 
ERIE, ?A ' 



« • 



SANT-Pji. r. CHALMERS 
AUGUSTA COUNTY SCHOOLS 
STALWCN, VA 

FRANCES CHRISTL--} * 
c'pPCRTJNITIES INDUSTRIALIZATION INC ' 
WASHINGTON, D.C- 



. DR'. L. WILLIAM CLARK 
PEN ARGYL HI^H SCHOOL 
PEN ARGYL, PA 

WINSTON CLELAND . 

NEW CASTLE COUNTY SOTOCL DISTRICT 

WILMINGTON, DE 

DR. ZACmiE CLBiENTS . 
UNIVERSITY OF VERMONT 
. BURLINGTtiN, VT 

. GEORGE CLIFFORD 

TEMPLE UNIVERSITY ~ TEACHER CORPS 
PHILADELPHIA, PA 

' DR. J". ROBERT COLD IRON - . 
PA DEPARTMENT OF EDUCATION^ 
HARRISBURG, PA 

RdDI^ M. CONNER 
,T CHESTERFIELD PUBLIC SCHOOLS 
CHESTERFIELD, VA 

SISTER FRANCIS BORGIA CONNORS 
. -ARCHDIOCESE OF PHILADELPHIA 
PHILADELPHIA, PA 



M. T. CONWAY 
EIC - CENTRAL 
PRINCETON, , NvJ 



DR. THOMAS CORCORAN ^ 
NJ DEPARTMENT OF EDUCATION 
TRENTON, N J 

BETTY CORNELL - * ' 

METHACTON SCHOOL DISTRICT 
FA^RVIEW 'VILLAGE, PA 

MS. MARILYN CR.AIG' 

RESEARCH FOR BETTER SCHOOLS • 

PHILADELPHIA, PA 

DR. ALBERT C. CRAMBERT 

HEW REGIONAL OFFICE OF EDUCATIONAL PROGRAM 
PHILADELPHIA, PA' 

DR. IVON CULVER 

UPPERy DARBY SCHOOL DISTRICT 

UPPER DARBY, PA 
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d'k. VIRGINIA L. DALTpN 
YA. EDUCATION ASSOCIATION 
•'RICHMOND, VA 



ANDREA D'.XNGELC 
PENNSBURY SCHOOL 
FALLSINGTON, PA 



RICHARD 
COLLE 



DEVANEY 

ILLE-TRAPPE ELE^ENTARY SCHOOL 



COLLEGS^ILLE, PA 
ELIZABETH' DODD 

NEW SRU-NSWICK BOARD OF EDUCATION 
N^ BRUNSWICK, NJ > - . 

SISTER JOSEPH DOLOPa^, I.H.M. 
DICCESE OF HARRISBURG' 
. HAJJJIISBURG,- PA • 

TH:MAS DONNE LL 

EAST LiJnSDOWNE AND GREEN AV S'CHOOL 

lansbowne, pa 

Ji2.<ES P. DORWART . 
PA DH?T. Or EDUCATION 
fiARRISBURG, PA 

robert r.. dungan 

upper merion junior high 

ki:;g of prussl\„ pa . • 

dr. ronald edmonds 

bo.^ps) of education of new york city 

?rookly:^, NY." 

STF/E>* A. E'^IRIGirr 

TEA.CHERS ASSOC. OF A2WE ARUNDEL CO . 
A?^^,-APCLi3, .MD 

DR. PATRICIA F. -EYRING" ■ ^ 
CCUNCIL RCCIC SCHOOL DISTRICT 
N'EVrrO^W. PA ^, 

BETH FAILS 
EIC, - NW , 
MORRIS PLAINS, NJ 

JOSEPH F. FALCO 

UPPER MHRION JUNIOR HIGH 

Ki:«3 OF PRUSSIA, PA 



JOHN FANNING 

RIDLEY SCHOOL DISTRICT 

FOLSOM, PA 

FRANCIS C. FARLOW 

MD STATE DEPARTMENT OF EDUCATION 

JOPRATOWNE, MD 

RUSSEL W.' FAUST • 

MD STATE- DEPT OF EDUCATION 

COLUMBIAi- MD 

PETER FINCK , J 

MD STAI^^DEPT OF EDUCATION 
BALTB10RE, MD 

THOMAS J. FINLEY 
NESHAMINY SCHOOL DISTRICT 
LANGHORNE, PA 

.PATRICIA A. FISHER 
PITTSBURGH, PUB^flC SCHOOLS 
PITTSBURGH, PA ' - 

RICHARD E. FLICKINGER 

OWEN J. ROBERTS SCHOOL DISTRICT 

POTTSTOWN, PA - 

DR. THORAS R. FOSTER 
• BALTIMORE CITY PUBLIC SCHOOLS 
BALTIMORE, MD 



DR. CLIFFORD G. FRANKS 

TREDYFFRIN - EAS?rTOW>E SCHOOL DISTRICT 

BER'WYN, PA 

DORIS 'L. FREEMAN 

PROJECT 81 COORDINATOR 

KING OF PitUSSIA, PA \ 

DR. DALE E. FRY 
SPRINGFIELD SCHOOL DISTRICT 
S?RI>]GFIE1D, PA 

PHILIP E. GEIGER 

GALLOWAY 'township- PUBLIC SCHOOLS 
POMONA, NJ ^ 

DR. WILLIAM J. GEPPERT, 
.STATE ^DEPT.' OF PUBLIC INSTRUCTION 
' DOVER, DE 
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TKCMAS GHL^RD 
^ WASHil^igTpN SCHOOL ^ 
MT. LEBANON, PA 


■ .CARL E. HEIIKAN 

?\ DEPARTMENT OF EDUCATION 

HARRISBURG, PA- 
'S 


■ JUDY -GINSBERG ■ 
SHA.MDNT SCHOOL 

PHILADELPHIA, PA / 

• / 


-JOHN R. HEYCCCK ' , . .'^ 
• PA DEPARTMENT OF EDUCATION 
HAIiRISBURG, PA 


DAVID GOBEL 

WILLIAM PENN SCHOOL DISTRICT 
YEADCN, PA 


OSWALD V. HICKS ^ ' 
• HARRISBURG SCHOOL DISTRICT , 
HARRISBURG, PA . 

• * 


^CKN L. GOULDING 

TRENTCN BOARD bF EDUCATION 

TRENTON, ■ N J ' : 


' ^ DR. WiLLIAM L. HIRES 

UPPER DARBY SCHOOL DISTRICT 
■ UPPER DARBY, PA 


o DR. EGCN G. CUBA \ 
LVDIA^^A UNIVERSITY 
BLCCMINGTON, INDIANA , 


DR. GERALD M. HOGAN 
SCHOOL. DISTRICT OF HAVERFORD TWP 
• HAVERTOWN, PA ° . ' . 


DR. CARL GUERRIERO , . . 
PA DEPi-RIMENT OF EDUCATION 
KARRI 3 BURG ,^ PA 


DR. ALICE A HOLDEN 

MD STATE DEFT OF EDUCATION 

TOWSON, MD 


DR. JA:rE E. GULICX - 
• 'LC'r^R .MERION SCHOOL DISTRICT 
ARDMCR2, PA ' 


DR. JOHN E. HOPKH^TS ' • 
RESEARCH FDR BHTrEK SCHOOLS 
•PHILADELPHIA, PA ' ' - 


VLAR-I-i-RTT GURKIN 
AUGUSTA COUNTY SCHOOLS 
STALriiTCN, "/A ' ■ 


. LARRY HOPP • 
NEW CASTLE COUNTY SCHOOL -DISTRICT 
WILMINGTON, DE ' . , " _ ; / 


JOHN A. HAAG 

CJJJNAMINSON PUBLIC SCHOOL 
KIGCRESTOWN, N J 


ELEANOR V. HORNE . 
EfllC/TM ■ 
PRINCETON, N J 


DR. TrlOIvlAS S. fJAMMILL 
EIC - .W ■ 
• MORRIS PLAINS, N J ' 


BETTY -b. HUGHES ' • • 
FLORENCE TOWNSHIP 
•FLORENCE,' N J ■ , 


hl'rl^ hanley , * 
repe-^ch for better schools 
pkil;^xel?hia, pa 


DR. MADELINE HUNTER 

UNIVERSITY ELEMENTARY SCHOOL/UCLA \. 
LOS ANGELES, -CA ' • 


PAUL HARR 

G/JiRETT COUNTY ' ' ' ' 
OAKLAND, ^^p . 


^' PETE . IDSTE'iJ^ 

NEW CASTLE COUNTY SCHOOL DISTRICT 
WILMINGTON, DE . 


SYDELLE EATOFF 

RESEARCH FOR BETTER SCHOOLS . 
■ PHiLOELPHpJc, PA ' , 

< 

* • 


GLORIA JORDAN 

OPPORTUNITIES INDUSTRIALIZATION CENTER 
WASHINGTON, D.C. 

ALAN KAPCZYNS^I 
RIDLEY SCHOOL' DISTRICT 


ERIC ' . . 


FOLSCM, PA , 
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^ ' . - ■ 
' MABICN C. KARL 
ALLEGHENY lifTERMEDIATE UNIT 
PITTSBURGH, PA 

DR. MtCHAEL KL^N 
SCHOOL DISTRICT OF PHIlAJE^HIA 
PHIUDEy>HIA, PA 




DR. SADIE S. KEEN 

APPOQUINIMINK SCHOOL DISTRICT 
HIDDLETOWN, DE 

DR. KEITH' KERSKNER 
•RESEARCH FOR BETTER SCHOOLS 
EKILADELPHLA, PA 

ERMEST KIMMEL \ 

EDUCATICNAL TES;riNC SERVICE • 

-FRINCETCN, NJ • 

" DR. HAJIRY J. KLEIN 
CE-rnL\L .BUCKS SCHOOLS 
-DCYLESTOWH, PA «• 

STEPHEJ* KLSI?I ' • 
E3UCA.TI0NAL TESTING SERVICE 
PRINCETON, 'N J 

D-^VID KR.\NTZ 

MCRF.ISVXLtE SCKOCL DISTRJECT 
MORRIS^/-ILLE,^PA . ^ 

LARRY KSANZIIAK 

LAV/RENCE TOWNSHIP PUBLIC SCHOOLS 
LA'VRENCF/ILLE, NJ 

• DR. MAXELL KUSHNER. 
RO'iVE:^ SCiOOL ' 
PHILADELPHIA, PA- 

ANrTHCNY ^. UBRIOLO 
TfJSCARCPjl. INTERMEDIATE UNIT 
MC VF/TOV*N, PA . . ' 

RAGGTE C. LANE • 
BALTIMQRS URBAN LEAGUE INC 
J BALTEviORE, MD • 

JAMES 0. LEE l ^ . ' 

NESF-iMINY SCHOOL DISTRICT 
LA-^«3HCR.NE, \ 

PHYLLIS ^iCSP.^RRA . ■ • 

I.-U. #21 CARBON \ LEHIGH 
' SCHNECKSVTLLE, PA ^ 



IRWIN LEYENTHAL , , 

HARRITON HIGH SCHOOL / 
ROSEMONT, PA 

MS KATHLEEN LINDENHOFEN ' 
RESEARCH ppR BETTER SCHOOLS 
..PHILADELPHIA. PA ^ 

DR. ALBERTA H LINDSAY 
COUNCIL ROCK SCHOOL DISTRICT 
WRIGHTSTOWN, PA 

MRS. .E^v LOMBARD I 

CHESTER UPLAND SCHOOL DISTRICT 

CHESTER, PA 

» 

KENNETH M. LONG 

EAST NORRITON MIDDLE SCHOOL 

NORRiSTOWN, PA 

b^.^'TRANK LYMAN 

WASHINGTON SCHOOL 
MT LEBANON, PA 



ll 



LORETTA 

WASHINGTON -SCHOOL 
MT LEBANON, PA 

DR. DOUGLAS MACBETH 

RAMBURG AREA. SCHOOL DISTRICT 

HAMBURG. PA 

^MILTON MARKLEY 
COBBS LOWER SCHOOL 
NEWARK, DE 

U^WRENCE E- MARTLN 
BUCKS COUNTY I.U. #22 
D0YLE"5T0WNi PA 



MARY LOU MARTIN , 
APPOQUINIMINK SCHOOL DISTRICT 
MIDDLETOWN, DE 

MARY MARTINEZ 
MOUNT RAINIER, MD 

DR. LOUISE MASLIN 

NEW CASTLE COUfTTY ' SCHOOL DISTRICT 

WILMINGTON, DE 

JAMES I. MASON 

RESEARCH FOR BETTER SCHOOLS 
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PHILADELPHIA, PA 
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JAMS3 R. vMASTERS 
. • PA ,DE?T OF EDUCATiaN 
HARRISBURG, PA 

►'CHARLES M. MICKEN • 
DOWNINGTOWN AREA SCHOOL DISTRICT 
DOWNI}CTON, PA 

C. DAVID MILLER 
ALLENTOWN SCHOOL DISTRICT , 
• ALLENTOWN, PA^ " 
• 

CAROL T, MILLER * 

MARYLA.NT) STATE .TEj^-CHERS .\SS0C" " 

BALTIMORE, MD 

JOAN A. MILLER 
. SCHOOL DISTRICT OF PHILADELPHIA- 
PHILADELPHIA, PA 

GILSERT E. MIMACCI • ' 

PRi>!CS ELEMEYTARY SCHOOL ' 
PRIM03, PA 

SR."Si-\RY LOUISE MCRAN 
DIOCESE OF TRENTON 
TRENTON, N J - 

f 

3YRCN R. MORRIS 

• AUGUSTA COUNTY Sci^COLS 
STAWrrCN, VA 

^ joseph morton 

"md state dept of education" 

BALTINfCRE, MD 

LOIS MOSES ■ 
NEW CA.STLE CpUNTf SCHOOL DISTRICT 
. WILMINGTON, DE 

iGP^Y L. MOYER 
PA DB?T OF EDUCATION 
^.ttARRISBURG, PA 

PHILLIP MUMAFQ '* ' ' " 

UNION AVENUE SCTOOL 
MARC^ATE, N J 

•JAMES" F. MC CAFFERY 
•ABINGTCN SCHOOL DIS^TKICT ' 
ABINGTON, FA 

DR. WILLIAM J. MC CORMICK 
' • DEPT OF PUBLIC INSTRUCTION 

• DOVER, DE 

ERIC 



SR. ROSE ANITA MC DONNELL 
ARCHDIOCESE OR PHILADELPHIA 
PHIIADELPHIA, PA 

FRANCIS A. NETyTON 

SELINSGROVE AREA SCHOOL DISTRICT 

SELINSGROVE, P;^ • ' 

JEAN, 0' DONNE L^ 
SHAWMONT SCHOOL 

PHILADELPHIA, "PA ^ 

PHYLLIS .PARANZINO , 
SHAHMONT SCHOOL . : ^ 

.PHILADELPHIA, PA " " 

DEL PARK 

GREAT -VALLEY SCHOOL DISTRICT ' 
DEVAULT, PA 

DR. JOHN PARRES - ■ 

NEW CASTLE COUjmf SCHDO;. .DISTRICT 

WILMINGTON, DE " ' ■ ^. - 

LUCILLE PASCALE 
. LAWRENCE TOWNSHIP PUBLIC SCHOOLS 
LAWRENCEVILLE, NJ . g-- 

DR. ED PATRIGC 

RESEARCH FOR BETTER SCHOOLS 

PHILADELPHIA, PA 

DR. THOMAS E. PERSING 

UPPER PERKIOMEN 'SCHOOL DISTRICT 

EAST GREENVILLE, PA 

^^DR. RICHARD M. PETRE ; 
MD STATt DEPARTMENT OF EDUCATION 
BALTIMORE, MD 

■ GEORGE E. PLOSA 
HATBORO-KORSHiVM SOiOOL DISTRICT 
HORSHAM, PA • 

DR. LINDA POLIN 

■CENTER FOR THE STUDY OF EVALUATION/UCIA 
„ LOS" ANGELES, CA 

ADELE PORTER 
T M PI£RCE 
PHILADELPHIA, PA 

DR; JAMES B. PUGH 

LOWER MERION SCHOOL DISTRICT 

ARDMORE, PA ^ 

. \ 
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-BRANCES qUINTO 

NATIONAL EDUCATION ASSOCIATION 
»' WASHINGTON, D.C.. 



ELMOR£ £. RAINEY 
PET2RSBURG PUBLIC. SCHOO.LS 
PETERSBURG, VA 

FRANCIS J. REARDON • a 

?A DEPARTMENT OF EDUCATION 
. HARRISBliRG, PA 

t 

:jaStPH M. REAVY 
CHcLTENHyiW HIGH SCHOOL 
WYNCtfTE, PA • 

ROBERT M. RESNICX 
■ LAWRENCE TOWNSHIP 'PUBLIC SCHOOLS 
LAWR£NCHVILL£, NJ 

DR, JERQUE A. R^TELLO 
SCHOOL DISTRICT OF x PHILADELPHIA 



PHILADELPHIA, PA 



ROBERT N. REYNOLDS 
PA DEffAR-WENT OF EDUCATION 
■ HARR'iSBURG^ PA 

DR. ED RI'ZHARDS 
RZ3E--1C-I-: FOR 3ETTHR SCriOOLS 
,PHIL\DH£PHIA,"PA 

WILLIAM H« RICHARDS 
WIUIAM FENN HIGH SCHOOL 
•PHILADELPHIA, PA 

ANN'. S. RICHARDSON 
CH'KRLES .COUNTY BOARD OF EDUCATI^ 
LA PLATA, MD ' 




MR. W, ROBERTS -RICHMC?iD 
HEW REGICTJAL OFFICE OF EDUCATIONAL 

PROGRAMS 
PHILADELPHIA, PA 

MS. JANE ROBERTS 

RESEARCH FOR BETTER SCHOOLS 

PHILADELPHIA, PA ' 

WILLIAM RODGERS 
FOXCROFT SCHOOL 
PITTSBURGH, PA 
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DR. SUE ROOT' 

RESEAIICH FOR BFTTER SCHOOLS 
PHIUDELPHIA, PA ' 

RUSSELL H. ROPER 
PEN ARGYL AREA SCHOOLS 
JZR ARGYL, PA 

FRED R0SEN2WEIG 

MORRI'S HILLS kEGIONAL DISTRICT 
ROCKAWAY, N J 

MS. MARCIA SACHS 
- RESEARCH FOR BETTER SCHOOLS 
PHILADELPHIA, PA 

DR." JAMES SCHEIE 
PHILADE'LPHU SCHOOL DISTRICT 
PHILADELPHIA, PA . 

RICHARD -v. SCULLIN 

HAVERF(^D TOWNSHIP SCHOOL DISTRICT 

HAVERTOWN, PA <o 

MARIE SEGAL " ' ' ^ ^ 
TEMPLE UNIVERSITY TEACHER CORPS 
TURNERSVILLE, NJ 

DR. RICHARD SELTZER 

COaT^BIA BOROUGH SCHOOL DISTRICT 

COLUMBIA, PA 

SUSAN SHERWIN 
" EDUCATIONAL TESTING SERVICE 
PRINCETON, N J 

EjLZCRA SHOULTZ 
^DR . TANNER G . DUCXREY SCHOOL 
PHILADELPHIA, PA " 

BETTY SHOWELL ' ' ^ 

MARYLArn) STATE DEPT CF EDUCATION 
BALTIMORE, MD 

MR. MICHAEL SIMEONE 
RESEARCH FOR BETTER- SCHOOLS 
PHILADELPHIA, PA 

ERNEST SIMON 
JENKINTOWN ELEMENTARY 
JENKINTOWN, PA. 

ENOCH SISSELSKY' 

PITT<? BURGH PUBLIC SCHOOLS 



\ 
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>}<(Aa>IA GOa'B-SMITH 
N.^. OEPARtMENT OF H)UCATION 
TRENTON, iV J - • 

CLAUDE SPENCER^ 

NEW CASTLE Ca'OTY SCHOOL DISTRICT 
WILMINGTON, DE 

JAMES ?r. SPENCER A ' 

HARYUND STATE TEACHERS ASSOC. 
BALTlilORE, MD / 

tSSrC- DAVID A. SQUIRES 
RESt-XRCH FOR BtflVhii SCHOOLS 
PHIL\DEL?HIA, PA 

PAUL A. STERLING 
PeiNS3UR>* SCHOOL DISTRICT 
FALLSINGTCN, PA 



fred r. sthiyart 
>iesfa:»ilnt school district 
l\/ighcr:ie, ?a 

william j. stinger 
neshxmin-y sc400l district 
l\ngh0r5e, pa 

3E^;HRLY C. STOflcSTREHT 
MARYLVh) STATE TEACHERS ASSOC- 
BALTISICRE, 

. f 

SUE SLTD 

HOWARD MIDDLE SCHOOL 
ALEXANC-ER, VA ' * 

MS. J AS SUTTON . 

CHrrrER ?qr the stjdy of 

. E\'-.\LUATICN/UCLA . „ 
LOS ANGELES, CA" 

D R. A MTfS E. SWEET 

^ji . c.-vS IjLT.G city SCHOOLS 

PETERSBURG, VA 

.MARIANNE -3YMON0WIC2 ' ^ 
TRENTON BOARD OF EDUCATION 
TRENTON, N J 



:'1ARL^ P tsichert 
EIC - NW' 
MORRISTpWN, N J 



EDWARD A. TEICHERT 
EIC - NW . 
MORRISTOWN. NJ ' 

DR. LOREN J. THOMPSON 

NEW CASTLE COUNTY SCHOOL DISTRICT 

WILMI.NGTON, DE 



DR. LOUISE A. TANNEY 
MARYLAND STATE DEPT OF ^UCATION 
BALTIMORE, MD 



^U 



SELMA L. TOLINS , * 

METHACTON SCHOOL DISTRICT 
FAIRVIEW" VILLAGE, PA ' 

CLARK TCMLINSON 

COLUMBU BOROUGH SCHOOL DISTRICT 
COLUMBIA, PA 

RITA TOLBERT 

RESE-\RCH FOR BETT^ SCHOOLS 
PHILADELPHIA, PA • 

DR. SHARON TUMULTY , 
RESEARCH FOR BETTER SCHOOLS 
PHILADELPHIA, PA 

ui. JOHN S . . TARD I BUONO 
SCHOOL PISTRICT OF LANCASTER 
LANCASTER,: PA ■ ^ 

DR. RICHARD T. TAL3ERT 
GOOCHLAND CCJJNTY PUBLIC SCHOOLS 
GOOCHLAND, VA 

ALICE L. VALDESI 

DEPARTMENT OF PUBLIC INSTRUCTIQN 
DOVER, DE 

GERALD,INE B. VAN LEAR 
AUGUSTA COUNTY SCHOOLS 
STAUNTON, VA 

CARLA WRIGHT 

L/VWRENCE TOWNSHIP PUBLIC SCHOOLS' 
LA.WRENCEVILLE,- NJ 

DR. CAROLYN WOOD 

HARFORD COJNTY PUBLIC SCHOOLS 

BEL AIR, MD- 
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R. WILMER WISE ' 
DEPARTT.IENT OF PUBLIC INSTRUCTION 
DOVER, DE ^ 

DR. CHESTER E. WESNER 
CHICHESTER SCHOOL DISTRICT 
BOOTHWYN, PA 

NELSON E. -WEBER 

LTPE^ PERKIOMEN SCHOOL DISTRICT 
'EASr*GRE3VILLE, PA 

tG-iARL^S WAYES 

UPPER ?ERKIQ(!JEN SCHOOL DISTRICT 
EAST GREE-ATILLE, PA 

RF/cRH.\T) MSGR. DAVID E. W^Js " 
.MICHDICCESE OF PHILADELPHIA 
?HiLADHLPHL\, PA 



CAP YFITER . » 

RESEARCH FOR BETTER SCHOOLS • " . ' 

PHILADELPHIA, PA o ' 

DR. METRO YURCHAK 

BUCKS COUNTY INTERMEDIATE UNIT #22 

DOYLESTOWN, PA / 

JOE ZAPOTOCLNy^ ' 
•AUGUSTA COUNTY SCHOOLS 
STAUNTON, VA 

fJarsha ZEKNER 

ANNVJLLE-CliONA SCHOOL DISTRICT 
ANNVILLE, PA 



JOSEPH 20NDL0 

A. TIGHE SCHOOL 
MARGATEy N J 



1/ . 



PATRICIA L. WALLER 
SAaNTORD SCHOOL 
HOCXESSIN, DE 

EARL WITH 
BLi-SXE-NSBLTlG SCHOOL 

pm!:l5lDHl?hia, pa 



CHERYL 'A-EDIER *» 
EDL'C^TICNAL TESTI>C SERVICE 
•PRDiCETCN, M J 

DR. MICHAEL V. WOODALL 
MILFCRD 3C-iOGL DISTRICT 
MILrORD J^DE 

JAiN'cT ??A^L 

DE?aR1?.IENT of PUBLIC INSTRUuTICN . 
DO^/ER, DE 

(CEITd W. YACXEE ^ 
PA DEPARTI'ENT "OF EDUCATION , . 
HARRISBURG, ?a_.. . 

DR.~i. ];^irA'GCD yarman 

HEW REGIONAL OFFICE OF EDUCATIONAL 

PROGRAMS 
PHILADELPHIA, PA 

JA*MES YENSER 
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REGION VI , , 

Conference Parti ci pants 



Alfredo Gavito . 

Research Assistant,. Bilingual, Education 
Houston Independent School District 

i Brenda Marshall 

Data Analyst 
^ Houston Independent School District 

Shirley Stillwell . ^ 
Administrator 

Palestine Independent School ■ District 
S. WilViams 

Director, Graduate School 
Hbustan Baptist University 

'Marty Thiersen 
Teacher 

Dfeerpark Independent\School District 

Harry Selig . , . ^ 

<?Research Assistant 
Houston Independent School District 

Aaron McBride 

Counselor * / 

Houston Independent School District 

Cheryl Stanly - 
. Research Assistant 
Houston Independent School District 

< Naomi McQueen , - 

Guidance Consultant 
Region IV ESC 

John Pyper , • 

Assistant Director, Research 

Houston Independent Schpol District^ 

Bessie Mae Wells 
Comnittee Representative 
Houston Teachers' Association 

Connie Myers 
Site Coordinator 

Spring Branch Independent School District 



Jan Barrett i 

Assistant Director of Appraisal 

Spring Branch Independent School District 

Vicky Hardway 
Teacher 

Spring Branch Independent School District 

Barbara Hunt . - - ^ ' 
teacher 

Spring Branch Independent School District 

Karen Costner" 

Research Assistant 

Houston Independent School District 

Billie Thpmas 

Research Assistant ^ 
Houston Indeper:ident School District 

Dons Anderson 
Counselor 

Houston Independent Schpol District 
Joseph Wilkes 

National Institute of Education 



Clara Couch 
Consultant 

Houston Independent School District 

# 

Barbara Caster ^ 
Teacher 

Texarkana Independent School District 

Herschel Smith 
Superintendent ^ 
Rector Public Schools 

Donna Wright 

Research As^sistant 

Houston Independent School District 

Warren Simmons 
Teacher 

Houston Baptist University . 
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Conference Participants (continued) 



Helen Baker 
Student 

Houston Baptist University 

Darlene CantreVl 

CurriculHjm Coortlinator 

Pearl and 'independent School District 

Jim Schreider 

Curriculum Corrdinator 

cPearland Independent School District • 

Bob Trammel 1 

Director, Counseling 

Eagel Pass Independent School District 

'Sylvia Clouder 
•Student 

Houston Baptist University 

Magdalene Shepard 

Teacher * ' 

Houston Independent School District 

Andra Stubbs 
Student 

Houston Baptist University . 

- Ljllie Hopkins 
Teacher 

Houston Independent School District 
Don ;^oed 

Educational Testing Service 

'^John Hill 
• Staff Member . ^ • . 

Texas State Teachers' Association 

Sandy Walker • 

Teacher ^ 

Fort Bend Independent School District 

' Freda Parkes 
Educational "Design 

Palestine Independent School District 



/■ 



Iris Blythe 

Language Arts Ccordtnator 

San -Marcos Independent School District 

Alma Allen 
Principal 

Houston Independent School District 

Sheri Pennington 

Research/Evaluation 

Houston Independent School District 

Houston Jewkes 
Superintendent 
St. Charles Parish Schools 

Charley Mae Wclliams 
Teacher 

Houston Independent School District 

Joe Streeter 

Resea^h/Eval uati on 

Houston. Independent School District 

'Marc Gerety ^ - 

Teacher 

Houston- Independent School District 
G. Herbert 



Marjorie Silver 

Teacher ^ ^ 

Houston Independen^t School District 

Carolyn McBaughey - 
Student 

Houston Baptist U/iivgrsity 

•Beverly Bowhl is ^ . 

Director of Art 

Kinkaid Independent School Distr*ict 

Hector Mantolo 
AdministratoV 

Eagle Pass Independent School District 
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Conference Participants (continued )- 



Bin Hardgrave ^ ' ^ 

Assistant Director of Planning 

Corpus Christi Independent School District 

Gerry Richard 
Counselor 

Houston Independent School District 

Dolores Sandling 
Principal 

Houston Independent School District c 
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KBGION TV 

List OF PARTICIPANTS BY STATE 
SOUTHEASTERN REGIONAL CON^^RENCE ON TESTING AND INSTRUCTION 

JUNE 25-26. 1979 ' 

ATLANTA. GEORGIA v.^^^ 



ALABW/V 

Berryman, William C. 
Bonds, Rachel 
Causey, C. Richard 
Christopher, Sandra 
Clark, Judy 
Davidson , James 
De^b^erry, Regina 
Eni^ks, Elizabeth 
Hess, Anne 
Ksnnimer, Joanne 
McMillin, Barbara J. 
Orr, Cindy 
Owen, James E- 
Smith, Jane 
Smith, Roger 
Spears, Ted C. 
Trt^gue, Wayne 
Thompson, Anne 
Tur.iipseed, Jim 
Wyl-?e, Paul 



ARKANSAS 

Berry, Evalena 
Bi dwell, Nell a 
Carpenter, Roland 
Johnson, Bill 
Lester, Bobby 
Reed, Kerin 
Scott, Mary 

Robert 
Harold ^ 
Lynn 
Linda 



Scott, 
Smith, 
Snell, 
S pa nn, 
ThaTmueller, Leonard 



FLORIDA 

Crawford, Douglas 
^Crosier, James 

Darling, Don 

Fisher, Thomas H. 

Franke, Helen 
. King, Ruby 

Lee, Robert F. 

Miller, Linda ^ 

Patrick, John 

Pinkney, H.B. 

Puryear, Ada 

Smith, Janice P. 

Weed," Terry 

Winesett, Howard 



GEORGIA 

,Aikens, Linda V. 
Bazzle, Bob 
BeraJsnopf, Stan 
Brod^r, Fred"^ 
Brown; Dorothy 
Bulloch, Gerry 
Coleman, Brooks 
Creech, Elizabeth 
Fordham, Dennis 
Griffith, Don 
Hughes, Harold . 
Johnson, Billy 
Lee, Carolyn 
McCarson, Carole 
Mathis, Barbara 
Moore, Sara 
Neal , Peggy 
Newfield, John 
Pearce, Kathleen 
Pennington, Rartdy 
Rooks, Don 
Rountree^ Gwen 



' GEORGIA (cont'd) 

.Shaw, Margaret 
Shubert, Dorothy 
Sullivan, Jerry 
Sweigert^ Ray Jr, 
Watts, David 
Weber, Margaret 
Welsh, Iris 



KENTUCKY 



Brooks, Joanne C. 
Cantrell , Jacqueline M 
Curry, A. Fraeier 
Evins , John W. 
Hicks, Ben 
Kimbrough, Randy L. 
Shrewsberfy, Alice 
Sledge, Lydia 
Van Fleet, Donald 
Walker, James 



LOUISIANA 

Audriet, Gail 
Beasion., Frances 
Clements , Ray 
Crawford, Ruth 
Faser,- Patricia 
Hall , Gloria 
Hamlin, Delores 
Korgan , Marlene 
Jones, Judith . 
Leach, Pearl 

JLe Doux, Clarence 

^Ivaney, Kathleen 

'feck, Hugh 

Heese, Diane 
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LOLUSIANA (cont'd) 

Smith. Lloyd 
Soileau, James V. . 
Solar, Robert 
Twymon, Alfred 
Wi iliams, Joe 



MISSISSIPPI 



Brown, Nancy 
Eiheridge, John 
Everett, Dcaglas 
>1assey, Barbara 
. Mei , Patricia 
f*<osely, Dollie 
Nicola, Sandra 
Pouncey, Rex 
Rankin, Robbie 
Rigby, Larry 
Sturgis, James 



SOUTH CAROLINA (cont'd) 

Mack, Marian C. / 
'Matthews, John W. 
May, John 
Meredith, Vana H. 
Mizpll , Hayes 
Mullen, Jeanette L. 
Nesbit, W. Ben 
Peterson, Terry 
Phillips, Jean 
Reeder, Henry* 
Reid, Marshall 
Rex, Ann 
Sandel , Dan 
Sandif^r, Paul D. 
> Taylor, Joel 
Taylar, Nelle H. 
Trammel 1, Mrs. Harrison 
Waddell , Maurice 
West, Ron 
Wilhide, James 
Williams, Qharlie G. 



NC?!TK CAROLINA 



TENNESSEE 



Burch, Jim 
/Conner, H.T. 
Hell man , Mark 
Less iter, Janice. 
Proctor, Br^nda 
Redfisarn, William 
Thorne, Sue 
Trivett, Clark 
Yeager, J. Frank 



SOUTH CAR OLINA 

Doling, Benjamin 
Curaton, Jennye 
Davis, Johnny ^ 
Flynn , Kohl an 
Hawisher, Margaret 
Hunter, Harriet 
Hynds, William 
tlohnson, James A. • 
Kel ly, Mary 
Lister, Martha 



Crockett, Bill 
Graham, Dolores 
Minor, Joe 
•Smith, Elizabeth 
Warren, Jessie 



OTHER PARTltlPANTS 



Burry, Jim (UCLA) 

Fincher, Cameron (Univ. 6A, Athens) 
Gallagher, James J. (FPG Child Dev. 
Hai:;iy, Roy(ETS) 
Hodgkinson, Harold (A.M.A.) 
Johnson, Reese (USOE, IV) 
Lewis, William L. (USOE, IV) 
Lovegrove, John (USOE, IV)- Jl. 
Orenstein, Diane (UCj^A) 

Scott, Corinne (NIE) • 

Weber, Margaret (ETS) ^ 
Womer, Frank (Univ^ Michigan^ 
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CSE PARTICIPANTS « - 

EVA L BAKER is Director of the Center for the Stu4y of Evaluation and 
professor in the UCLA Graduate School of Educati-on. Her area ?f spe- - 
dalization is evaluation and instructional development. She hjs. written 
extensively on the topics of evaluation, testing, teacher education, and 
Instructional .research and developrr^^nt; Baker is frequently requested to 
consult with federal, state, and Vocal educational agencies. She is a 
Memb%r-a?-Large of AERA, and is' a member of the AERA Standing Go^^ttee 
on Research Training, and the CEDaR Board of Directors.. Baker directed 
CSE's evaluations of the Cal ifornia Early Childhood- Education Program 
' and School Improvement .Program. 

JANE COOGAN BEER, Director of Public Information, is responsible for"- 
institutional contacts with professional, Politi"^ ' ."f^^^lj^' ^"J,, 
univers^ity organizations and individuals. ,She coordinates CSE confer- 
ences, colloquiums, anr! visiting .scholars, ^"d. Provides information 
services to p^ooect staff." Ms. Bee>-, who received a B.A. from UCLA, 
ha: been vyith the Center since 1969. • • 

JAMES L BURRY joined the Xenter in 1967 and has been Managing, Editor 
of Eva uation Comment since 1970. He is currently directing the Re- 
°gio^ Conferences on Testing ^nd Ins^uction.. His ^Jher^ecent activ - 
ties include -dire^cting CSE Field SeWtces, directing the Technical Assis- 
tance Project for the California Bilingual Census and working w th the 
TeScher Corps, the R&D Utilization Program, the Joinen^.and M^nontie . 
Training Program, and Dissemination Services. His^perience in evalua- 
tion Ilso includes development and implementation &f training packages 
aJconsullation with school districts and state education agencies. . 

LINDA GALE POLIN received, a B.A.' jn" English at UC Santa Barbara and an 
M A at the UCLA Graduate School of Education where she 1^ .^^^^j^jjly a 
doctoral student in learning and instruction. )Prior joining the CSE 
Jaff she worked on a multimedia instructional Program for hand capped 
students in mainstream classes through a^contract wUff the Bureau of 
Education for the Handicapped; she has aiso ^een a teacher s aide at the 
elementary and adult levels, folin's responsibilities at CSE have in- • 
c uded the EBCE Audit; writing and presenting tra/ning sessions at thOr 
R g al conferences ^n Testing and In^truction;/research on wn mg - 
mains; the development of eighth grade reading, writing, math measures 
for the California School Improvement evaluation; and special sh/rt- term 
evaluation efforts. 
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SHELBY POPHAM received a B.-A. in English at UCLA, and is concurrently 
enrolled in gradijate programs at UCLA' in the" ■Department of Comparative 
Literature and T.E.S..O.L.» She has assisted, witht many CSE projetts. 

JAN SUTTON has an M.A. in English from UCLA and 'is a doctoral student 
in the UCLA School of Education program..in learning and instruction-. 
She has'''taught many high school subjects, and worked as a high school 
counselor, training "teacher, and curriculum specialist for the Los 
Angel-es City Schools. In addition to this present project she has 
participated in CSE's pro^ject on Evaluation and Decisionmakinjg in 
Local School • Districts. ' ' 
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